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ABSTRACT 


The  evaluation  process  currently  planned  for  the  national 
Training  Center  at  Fort  Irwin,  California,  is  examined  and  a 
■ethodology  proposed  for  evaluating  unit  tactical 
proficiency  froe  the  data  accumulated.  The  concept  of  a 
Training  Readiness  Profile  (TRP)  is  suggested  as  a  concise 
aethod  for  assisting  the  Battalion  Coaaander  and  his 
subordinates  in  meeting  the  training  objectives  of  Fff  71- 1, 
Ft!  71-2,  and  AHTEP  71-2.  This  concept  is  applicable  to 
Araored  and  Infantry  battalions  and  to  their  training 
programs  as  currently  specified  under  Department  of  the  Aray 
doctrine.  This  methodology  is  coapatible  with  the  automated 
information  retrieval  systems  currently  being  specified  for 
installation  at  the  Rational  Training  Center. 
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I 


The  nission  of  the  United  States  Army  is  to  fight  in 


ground  combat  and  win.  Proa  PM  100-5,  Operations  [Ref.  1  J, 


"The  Army’s  priaary  objective  is  to  win  the  iaaJ  battle 
to  fight  and  win  in  battles,  large  ana  small,  against 
whatever  foe,  wherever  we  aay  be  sent  to  war."  [Ref. 

1 : pg.  1-1] 


This  aission  stands  essentially  unchanged  since  the  earliest 
days  of  the  Republic,  yet  the  world  has  changed  dramatically 
in  the  intervening  years.  Increasingly  complex  technology 
has  expanded  the  range  and  lethality  of  all  weapons  on  the 
battlefield  to  such  an  extent  that; 


"We  can  expect  very  high  losses  to  occur  in  short  periods 
of  time.  Entire  forces  could  be  desroyed  quickly  if  they 
are  improperly  employed. . . "  (emphasis  added)  [Ref.  1:pg. 
1-1  ] 


Therefore,  now  as  never  before,  the  Army  must  train  in 

peacetime  to  be  victorious  without  the  traditional  long 

period  of  mobilization  which  has  characterized  the  entry  of 

the  U.S.  into  all  its  other  wars. 

"Today  the  CT . S .  Army  must,  above  all  else,  prepare  to  win 
the  first  battle  of  the  next  war."[ Rer7“l :pg.  1-1] 

Within  this  century,  training  in  the  United  States  Army 
has  been  centered  around  the  mobilization  models  first 
employed  in  WWI  by  the  newly  formed  U.S.  General  Staff. 

This  traditional  model  assumed  that  in  the  conduct  of  war,  a 


1 1 


long  period  of  tiae  would  be  availible  to  raise,  equip,  and 
train  an  aray  while  the  continental  O.S.  remained  protected 
by  the  formidable  barriers  of  the  Atlantic  and  Pacific 
oceans.  This  training  followed  a  predictable  cycle;  the 
small  standing  Army  formed  a  cadre-nucleus  around  which 
units  were  constructed  from  a  large  pool  of  conscripts. 
Training  would  begin  with  the  individual  combat  skills, 
progress  to  squad,  platoon,  and  company  skills,  and  then 
these  units  would  be  aggregated  to  fora  regiments, 
divisions,  and  higher  echelons,  which  proceeded  through 
their  own  cycle  of  training  and  exercise.  At  the  completion 
of  this  process,  units  were  tested,  and  if  judged  fit, 
deployed  to  combat  theaters. 

This  cycle  worked  admirably  in  Bill  and  enabled  the  U.S. 
to  create  a  large  and  efficient  war  machine  quickly.  As 
this  was  a  proven  system,  it  formed  the  basis  of  all  Aray 
training  until  the  early  1970‘s.  At  that  point  in  tiae,  in 
its  final  fora,  Aray  training  consisted  of  the  cycle  as 
depicted  in  Figure  1. 

Each  stage  was  defined  as  listed  below  and  the  contents 
of  each  segment  specified  by  an  Army  Training  Program  (ATP) 
which  outlined  the  subjects  to  be  taught  in  training,  the 
number  of  hours  to  be  spent  in  training,  and  the  applicable 
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Figure  1:  The  ire;  Training  Cycle  (Obsolete) 


resources  and  references  to  be  used.  The  completion  of  a 


stage  was  evaluated  by  a  graded  test. 


BCT:  Basic  Combat  Training-  This  training  instilled  the 
fundamentals  of  infantry  combat  to  newly  accessed 
personnel.  [Hef.  2:pg.  19] 


AIT:  Advanced  Individual  Training-  Usually  conducted  in  a 
formal  setting  at  an  institution  which  resulted  in  the 
award  of  a  Military  Occupation  Specialty  (HOS) .  [Ref. 

2:  pc.  19] 


At  this  stage  an  individual  was  assigned  to  a  unit.  Here 


the  cycle  began  again  with: 


BUT:  Basic  Unit  Training-  The  initial  unit  training 
designed  to  insure  that  squads,  platoons, . and 
Company/Battery/Troops  can  accomplish  their  TO&B  missions. 
This  phase,  ana  all  others,  culminated  m  an  Army  Training 
Test  (ATT)  [Ref.  2:pg.  19]. 


AUT:  Advanced  Unit  Training-  Training  designed  to  insure 
that  Battalions  and  Brigades  cap  accomplish  their  TO&E 
missions.  This  phase  also  culminated  in  an  ATT.  r  Ref. 
2:pg.  19] 


Finally,  units  progressed  to  the  maneuver  phase  where  joint 


combat  arms  maneuver  characterized  the  training.  This  was: 
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OHT:  Operational  Headiness  Training-  Training  designed  to 
aaintain  the  highest  possible  state  of  coabat  proficiency. 
fReff.  2: pg.  21] 

it  this  point,  a  unit  was  considered  to  be  deployable  and 
trained.  Testing  by  OBTT  (Operational  Beadiness  Training 
Test)  was  regularly  accoaplished  in  order  to  deteraine  if 
this  status  was  aaintained. 

This  systea  was  fatally  flawed,  however.  Under  the 
pressures  of  personnel  turbulence  created  by  the  Vietnaa 
Bar,  standards  of  training  could  not  be  aaintained  in  an 
orderly  cycle  and  unit  readiness  suffered  greatly.  When 
this  deficiency  was  coupled  with  the  need  to  aaintain 
standing  U.S.  forces  at  peak  readiness  all  of  the  tiae,  and 
not  just  for  a  short  period  of  tiae  following  the  coapletion 
of  a  training  cycle,  it  becaae  clear  that  a  refora  of  the 
Aray  training  structure  was  necessary.  In  order  to  affect 
this  refora, the  Board  for  Dynaaic  Training  was  constituted 
in  1971  at  the  direction  of  the  the  Chief  of  Staff  of  the 
Aray  (CSA)  and  reported  its  conclusions  on  1 7  Dec  1971  to 
the  CSA  regarding  Aray  training.  Froa  these  conclusions  the 
concept  of  perf oraance-oriented  training  was  born.  [Bef.  3] 
Perforaance-Oriented  Training  (POT)  was  designed  to  do 
away  with  the  old  aobilization  cycle  of  training.  In  it,  a 
soldier  was  required  to  learn  by  doing  a  task  under  a  given 
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set  of  conditions  to  a  specified  standard.  The  previous  ATP 
had  specified  only  hours  of  exposure  to  training  which,  as 
any  noncoeeissioned  officer  (NCO)  knows,  does  not  guarantee 
the  absorption  of  the  skill  being  taught  by  the  soldier. 
Although  "hands-on  training"  by  doing  had  been  the  teaching 
policy  for  eany  years  in  the  Any,  this  new  method 
emphasized  the  attainaent  of  a  standard  as  the  final  goal, 
as  opposed  to  the  siaple  coapletion  of  the  requisite  number 
of  hours  of  training  with  or  without  acquiring  the  desired 
skill.  Under  the  POT  program  training  would  continue  (by 
doing)  until  the  desired  standard  was  achieved.  This 
concept  was  such  a  dramatic  departure  from  previous  Army 
practice  that  the  program  took  several  years  to  introduce  to 
the  field. 

This  philosophy  was  refined  and  promulgated  to  the  field 

Army  through  FH  21-6,  ggw  t£  Prepare  a&£  conduct  BilitarY 

Training.  3  Bov  1975  [Ref.  4J.  Ffl  21-6  officially  made  POT 

Army  doctrine.  Trainers  were  defined  as  those: 

"Whose  duties  include  the  requirement  to  prepare,  conduct, 
and  evaluate  training..."  [Ref.  4:pg.  2] 

and  these  trainers  were  instructed  that: 

"The  last  element  of  the  training  objective  which  you  must 
develop  i3  the  training  standard.  These  are  needed  to 
insure  that  the  soldiers  undergoing  training  will  be  able 
to  perform  the  commander's  objectives...  Training 
standards  are  normally  expressed  in  terms  of  L 

measurement...  or  in  terms  of  specific  procedures  which 
mu»t  be  followed..."  [Ref.  4:pg.  13] 
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Thus,  the  hey  to  the  training  systea  as  it  stands  today  in 
the  Army  is  the  training  standard.  The  initial  question 
then  facing  the  unit  trainer  is  how  well  does  the  soldier, 
or  collectively  his  unit,  need  to  be  trained?  Beyond  this 
question  of  basically  how  good  is  good  enough,  lies  the  yet 
sore  difficult  question:  how  do  you  evaluate  the 
accosplishsent  of  the  training  standard,  particularly  for 
large  units?  It  has  been  shown  that  setting  the  standard  is 
difficult  enough:  how  do  you  determine  if  sen,  units,  and 
weapons  are  capable  of  accomplishing  it?  Por  larger 
eleaents,  given  the  intangible  nature  of  war,  this  question 
becomes  a  crucial  issue,  and  one  very  difficult  to  answer. 

A.  THE  PROBLEH:  THE  EVALUATION  OF  TRAINING  STANDARDS  POB 

LARGE  UNITS 

With  the  dramatic  shift  from  the  accomplishment  of 
training  programs  to  the  accomplishment  of  training 
standards,  the  Army  incurred  a  new  burden.  Previously  an 
ATP  (or  any  cycle  of  an  ATP)  could  be  evaluated  on  a  graded 
basis  by  administering  an  ATT  to  the  unit.  This  could  no 
longer  suffice  as  an  evaluation  technique,  for  the 
prescribed  training  objective  could  only  be  considered 
reached  when  the  unit  or  individual  could  perform  the 
specified  task  to  the  given  standard.  The  reliance  of  a 
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unit  on  &  repetitive  cycle  of  "Train-Test"  in  lockstep 
fashion  was  broken.  In  its  place,  a  new  system  for  training 
■anageaent  was  prescribed.  In  the  introduction  of  this 
systes  the  Arny  specified  a  cycle  of  "Train-Evaluate-Train" 
which  encoapassed  the  new  philosophy  that  training  in 
general  should  be  an  iterative  learning  experience.  TC 
21-5-7,  Kaifliaa  amaaianl  ia  fiaiialia&s  [set.  5],  was 
issued  in  Deceaber  1977  to  introduce  the  new  cycle  (see 
Pigure  2) . 

This  general  concept  of  training  required  action  by  two 
agencies:  the  O.S.  Arny  Training  and  Doctrine  coaaand 
(TBADOC)  and  the  training  combat  unit.  TBADOC  provided  the 
defined  tasks,  conditions  and  standards  to  the  units  through 
the  aediua  of  the  Aray  Training  and  Evaluation  Program 
(ABTEP)  (Bef.  6]  and  with  the  A STEP  as  a  guide  it  becaae  a 
unit  responsibility  to  coaplete  the  iterative  "Train- 
Evaluate-Train"  cycle.  This  concept  also  applied  to 
individual,  collective,  and  unit  training  (see  Figure  3). 

However,  aoves  taken  to  decentralize  training  in  the 
early  1970 's  [Bef.  2:pg.  4]  effectively  devolved  this  cyclic 
responsibility  entirely  to  the  battalion  level.  TC  21-5-7 
states  bluntly: 

"The  clear  intent  of  the  policy  of  decentralization  is  to 
fix  such  responsibilities  at  battalion  level,  for  the 
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(TBADOC/ONIT)  (TBADOC)  (TBADOC/OBIT) 


Figure  2:  The  General  Concept  of  Training 


battalion  is  the  lowest  echelon  at  which  there  is  a  staff 
to  assist  with  such  (training)  duties."  [Bef.  5:pg.  20] 


Those  duties  were  Multitudinous,  but  aost  importantly,  they 


stated  that  the  battalion  headquarters:  "Assigns  tasks  for 


training  and  evaluates  results."  [Bef.  5;pg.  20] 


Thus,  unless  carefully  sonitored  through  external  ABIEP 


evaluations,  the  battalion  becase  a  training  entity  subject 


to  its  own  set  of  training  standards.  In  theory,  external 


ABTEPs  are  scheduled  and  accoaplished  by  a  brigade 
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Figure  3:  The  Concept  of  Training  at  Levels 
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headquarters  or  higher  echelon.  Due  to  the  nusber  of 
evaluator  personnel  needed  to  adsinister  an  ABTEP,  such 
events  are  usually  scheduled  by  a  division  which  esploys 
another  battalion's  conand  group  as  evaluators.  This 
perpetuates  a  vicious  cycle;  if  one  battalion  is  below 
standard,  it  cannot  evaluate  another  battalion  beyond  its 
own  level  of  coapetence.  Hence  the  Arny  wide  standard  once 
envisioned  for  all  units  becoaes  less  and  less  attainable  as 
evaluation  skills  reaain  linked  to  the  training  level  of 
other  sister  battalions.  It  thus  becoaes  quite  easy  for  two 
araored  divisions,  as  an  ezaaple,  to  report  the  sane  level 
of  training  readiness  in  all  honesty  and  yet  have  totally 
disparate  capabilities. 

This  situation  becoaes  all  the  aore  critical  when  it  is 


realized  that  the  ABTEP  tasks  and  standards  are  vague,  and 
are  frequently  interpreted  differently  by  individuals  of 
varying  skill  levels.  As  an  ezaaple,  for  a  coabat-ready 
tank  md  aechanized  infantry  battalion  task  force,  (Level  1) 
the  evaluation  standards  for  the  performance  of  a  hasty 
attack  are  as  follows: 


"b.  Coordination  of  artillery,  aortars.  air  defense, 
tactical  air,  engineers,  and  attack  helicopters  will 
support  the  scheae  of  aaneuver.  Maneuver  units  respond  to 
task  force  coaaander's  orders  using  overmatch  positions, 
aaziaua  suppressive  fires,  and  the  terrain  for  protection 
froa  opposing  force  fire. 
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c.  Task  force  aaintains  the  aoaentua  of  the  attack  and 
retains  the  initiative,  aggressively  seeking  the  opposing 
force's  weakness.  Suppressive  fires  will  be  coordinated 
to  neutralize  the  opposing  force's  ability  to  react.  Task 
force  assets  will  be  concentrated  to  overwhela  the 
opposing  force  at  selected  locations  and  control  key 
terrain  features. 

d.  Objective  is  secured  within  a  reasonable  tine  without 
sustaining  excessive  personnel  and  eguipaent  losses. 
(Evaluator  judgment.)"  [Hef.  6:pg.  8-2-2] 

The  use  of  such  phrases  as  "coordination  ...will  support  the 

scheae  of  maneuver"  and  "task  force  aaintains  (the) 

aoaentua  of  the  attack  and  retains  the  initiative"  is  not 

conducive  to  exacting  evaluation.  Such  words  can  aean  aany 

things  to  aany  people.  Even  scholars  of  war  and  veterans  of 

coabat  can  argue  justifiably  over  the  definition  of 

"retaining  the  initiative".  Such  descriptors  are,  in  aany 

cases,  unintelligible  to  junior  officers  and  HCOs  with  no 

coabat  experience.  Yet  these  individuals  are  aost  often 

directly  involved  with  the  evaluation  of  sister  eleaents  in 

the  accomplishment  of  an  AST BP. 

Clearly  then,  although  the  concept  of  "Train-Evaluate- 
Train"  is  sound  in  theory,  it  lacks  in  the  execution  of  the 
required  evaluation.  The  problea,  indeed,  is  two-fold:  the 
establishment  of  accurate  and  concise  training  standards  is 
extreaely  difficult  to  do  in  practice;  but  even  aore 
seriously,  the  evaluation  of  such  standards  by  the  untrained 
eye  of  an  observer  whose  own  experience  and  training  aay  be 
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no  better  (and  indeed,  aay  be  worse)  than  that  of  the 
individuals  being  evaluated  provides  little  tangible 
information  about  the  unit*s  real  coabat  capability.  Soae 
current  training  prograas  are  directed  toward  alleviating 
this  deficiency;  one  in  particular,  the  National  Training 
Center  at  Pt.  Irwin,  California,  aay  hold  the  key  foe 
breaking  the  vicious  cycle  of  half-coapetent  evaluation. 

B.  CURRENT  TRAINING  EVALUATION  BETHODS 

The  aethods  used  to  evaluate  training  accoaplishaents 
are  fairly  liaited  today.  Bany  of  thea  date  back  centuries 
to  the  siaple  concept  of  drill;  others  involve  laser 
technology  and  fast  coaputers.  The  training  systeas 
available  to  unit  coaaanders  at  the  present  fall  into  three 
basic  categories  and  possess  varying  degrees  of  exactness  in 
evaluation.  They  can  be  classified  froa  highest  to  lowest 
in  teras  of  evaluating  capability  as  the  skill  Qualification 
Test  (SQT) -crew  Drill-ARTEP  hierarchy,  the  Bultiple 
Integrated  Laser  Engageaent  Sysytea  (BILES)  training  device 
(including  all  such  variants  of  a  hit/kill  systea)  and 
various  field  aaneuvers,  such  as  the  Field  Training  Exercise 
(PTX)  ,  the  coaaand  Post  Exercise  (CPZ)  ,  and  the  Tactical 
Exercise  Nithout  Troops  (TENT)  . 
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1. 


Host  organizations  are  constructed  of  vertical 
hierarchies  and  the  ire;  is  no  exception  to  this  rule,  tilth 
the  introduction  of  POT  and  the  destruction  of  the  old 
training  cycle,  certain  vacuuas  were  foraed  in  the 
hierarchial  progression  of  training  froe  individual  to  unit. 
These  gaps  have  now  been  filled  by  what  can  loosely  be 


Figure  4:  The  SQT-Crev  Drill-ARTBP  Hierarchy 


teraed  the  SQT-Crew  Drill- ABTEP  hierarchy  (see  Figure  4). 
With  respect  to  individual  training,  the  Aray  has  published 
the  Soldier's  Hanual  [Ref.  7 ]  as  a  source  docuaent  for  the 
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Skill  Qualification  Test,  which  is  a  POT  version  of  the  old 


MOS  (Military  Occupation  Specialty)  Test  designed  to 
evaluate  individual  skills.  This  test  is  reasonably  well 
structured,  that  is,  the  perforaance  standards  are 
quantifiable  in  teras  of  a  go/no  go  perforaance.  Thus,  the 
SQT  evaluates  individual  training  by  asking  the  soldier  to 
perfora  a  series  of  unaabiguous  aostly  physical  tasks  which 
are  graded  either  pass  or  fail.1 

In  the  interaediate  range  of  training  crews,  squads, 
and  saall  collective  units,  the  iray  has  no  foraal 
evaluation  systea,  although  the  iray  Research  Institute  for 
the  Behaviorial  and  Social  Sciences  (ARI)  has  been 
tentatively  tasked  with  arranging  a  "squad  battle  drill" 
prograa.z  Several  inforaal  evaluation  systeas  do  exist  which 
are  fairly  quantitative  despite  their  lack  of  foraal 
institutional  standing.  Exaaples  of  such  evaluations  are 
tank  gunnery  evaluations  (Tank  Table  ?III)  which  require  a 
quantitative  passing  score  for  crew  perforaance;  infantry 
aachin e-gun  crew  qualification  standards,  artillery  gun  crew 


»It  appears  at  the  tiae  of  this  writing  that  the 
Congress  will  refuse  further  funding  for  the  SQT  prograa. 
What  iapact  this  will  have  upon  future  individual  training 
evaluation  is  unclear  at  this  tiae. 

*Based  on  a  conversation  with  Dr.  J. Banks  of  hRI.  June 
1981.  The  tasking  is  to  develop  a  series  of  standardized 
exercises  for  saall  units,  initially  infantry  squad?,  to 
foraalize  their  training  in  accordance  with  the  Tram- 
Bvaluate-Traia  cycle. 
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shooting  standards,  and  the  like.  All  of  these  evaluations 
are  slightly  less  quantitative  than  the  SQT  (there  is  no  way 
to  evaluate  the  driver's  shifting  skill,  for  exaaple,  on 
Tank  Table  Till  by  other  than  the  fact  that  the  tank 
proceeded  dovnrange  froa  target  to  target)  but  nonetheless, 
all  evaluations  of  this  sort  result  in  a  quantitative  score 
against  which  a  standard  can  be  adjudged. 

The  final  segaent  of  this  heirarchy  is  the 
previously  discussed  ABTEP.  The  ABTEP  itself  is  segaented 
into  platoon,  coapany,  and  battalion  portions,  aost  of  which 
rely  on  a  high  degree  of  subjectivity  in  their  assessaents. 
The  inherent  weaknesses  of  the  ABTEP  have  already  been 
discussed  in  the  previous  section,  and  generally  these 
weaknesses  apply  to  all  echelons  of  the  ABTEP  with  sone 
degree  of  increasing  subjectivity  and  aabiguity  as  the  unit 
grows  larger.  This  concept  of  a  hierarchy  is  suaaarized  by 
Figure  4,  showing  the  direction  of  increasing  subjectivity 
in  evaluation. 

2.  CEX,  _F_TX,..TggI,_a^d_Othec_Fi^itd_Maaeijye£ 

This  faaily  of  exercises,  which  consist  aostly  of 
field  aaneuver  without  an  explicit  opponent  can  be 
evaluative  or  educational.  Coaaand  Post  Exercises  (CPX)  and 
Tactical  Exercises  Without  Troops  (TEWT)  are  intended  to 
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train  staffs  and  coaaanders  without  the  expense  of  placing 
troops  in  the  field.  Such  exercises  are  beneficial  to  the 
leaders  involved,  but  when  these  aaneuvers  are  eade  into 
evaluations  the?  are  alaost  wholly  subjective  and,  in  fact, 
are  aissing  the  few  benefits  of  the  vague  ABTEP  systea  in 
that  they  totally  lack  established  tasks,  conditions,  and 
standards.  They  also  suffer  froa  an  additional  weakness  of 
possessing  fewer  observers  than  the  noraal  ABTEP.  Thus,  for 
evaluative  purposes,  the  CPZ  and  TENT  offer  less  value  than 
the  AETEP. 

The  field  training  exercise  (FTX)  suffers  froa  the 
saae  inherent  weakness  when  used  as  an  evaluation.  FTX’s 
are  quite  often  "canned"  with  little  or  no  free  play,  and 
provide  scant  opportunity  fcr  any  worthwhile  evaluation  of  a 
unit’s  coabat  capabilities.  Host  often  the  FTX  is  used  as  a 
tool  for  "exercising"  the  assets  of  a  division  by  forcing 
the  service  support  units  to  operate  in  the  field  for 
several  days.  FTX’s  in  their  structured,  scripted  fora 
offer  very  little  training  to  coabat  eleaents  and  cannot  be 
considered  to  be  efficient  or  cost  effective  as  evaluations 
of  training. 
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3 


The  NILES  (Multiple  Integrated  Laser  Engageaent 
System)  training  device  is  not  an  evaluation  aethodology  in 
itself  but  rather  is  a  tool  to  be  used  in  conjunction  with 
other  forms  of  training  to  increase  realism  and  thus  enhance 
evaluation.  NILES  consists  of  varying  types  of  eye-safe 
lasers  which  can  be  fitted  to  aost  Army  direct  fire  weapons 
froa  the  (116  rifle  to  the  105aa  tank  gun.  These  devices  are 
sound  actuated,  requiring  the  soldier  to  possess  a  blank 
round  of  aaaunition  and  a  functioning  weapon  in  order  to 
trigger  the  laser.  This  forces  units  to  accurately  perform 
maintenance  and  supply  functions  in  real  time.  Each  player 
in  a  NILES  exercise  is  then  fitted  with  sensors  which  can 
detect  the  strike  of  another  NILES  laser  beaa  on  the 
individual  item,  be  it  a  single  foot  soldier  or  a  tank, 
truck,  etc.  If  a  kill  is  registered,  it  is  signified  in 
various  ways.  Should  an  infantryaan  be  "shot",  for  exaaple, 
an  audible  tone  sounds  to  indicate  that  he  is  a  casualty  and 
his  NILES  weapon  is  rendered  inoperative.  For  a  larger  itea 
such  as  a  tank  or  APC,  the  kill  indicator  is  appropriately 
larger;  a  saoke  grenade  is  set  off  and  a  flashing  signal 
started  in  addition  to  the  insxrusented  weapon  being 
rendered  inoperative.  A  "dead"  BILES  systea  can  only  be 
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reactivated  by  a  controller  key  device.  In  this  Banner  the 
system  can  inflict  realistic  firepower  casualties  upon  a 
player  unit,  and  so  represent  coabat  losses,  fteapon  lasers 
are  also  coded  internally  within  the  bean  to  reflect  weapon 
type.  As  an  exaaple  of  this  it  would  be  iapossible  to  kill 
a  tank  with  the  beaa  of  an  a  16  coded  laser,  while  a  TO! 
coded  beaa  could  inflict  such  a  casualty.  The  RILES 
supporting  software  also  contains  a  aini-coaputer  which 
randoaly  induces  a  aiss  based  on  the  actual  probability  of 
kill  of  the  firing  weapon.  Thus,  although  it  is  easier  to 
aia  the  laser  and  strike  a  sensor  than  it  is  to  strike  the 
target  with  a  real  round,  the  system  automatically  induces 
realistic  weapon  performance  to  simulate  the  effect  of  real 
fire  from  the  given  weapon. 

RILES  promises  to  add  a  degree  of  realism  to 
training  exercises  such  as  has  never  before  been  known. 
Having  the  ability  to  "kill"  an  opponent  greatly  increases 
the  desire  of  troops  to  wholeheartedly  participate  in  mock 
battles,  while  possessing  the  ability  to  be  "killed"  causes 
then  to  seek  cover  aore  effectively  and  learn  aore  quickly 
the  price  of  their  mistakes.3  Therefore,  the  RILES  system 

3For  an  excellent  discussion  of  the  learning  rate 
increase  attributable  to  hit/kill  systems  see  the  REALTRAIN 
validation  studies  of  the  ABI  (References  8,9,10,  and  11). 
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can  be  seen  as  a  aultiplier  of  learning  effects  in  training# 
bat  contains  only  an  indirect  aethodology  for  evaluation, 
when  utilized  within  the  fraaework  of  an  ABTEP  style 
evaluation#  it  draaatically  increases  the  degree  of 
objectivity  in  the  evaluation  by  reaoving  the  need  for  a 
subjective  guess  at  casualties  during  a  force-on-force 
exercise. 

C.  THE  SHORTFALL:  THE  HEEDS  OF  EVALUATION  VEBSOS  THE 

CONSTRAINTS  OF  TRAINING 

In  considering  the  weaknesses  of  the  current  Aray 
training  systeas  it  becoaes  obvious  that  there  is  a  draaicic 
shortfall  between  the  the  theory  of  the  train-evaluat e-train 
cycle  and  the  hard  realities  of  current  training 
constraints.  The  lack  of  dedicated  evaluator  personnel 
forces  the  use  of  sister  unit  peers  as  pro  teapore 
evaluators;  the  lack  of  a  dedicated  opposing  force  (OPFOR) 
utilizing  threat  tactics  results  in  sister  battalions 
providing  the  aggressors  in  training#  causing  (IS  units  to 
train  against  US  tactics;  and  finally#  the  vagueness  of  the 
tasks  and  standards  in  the  current  ARTEP's  of  large  coabat 
units  effectively  eliainates  the  chance  of  efficient 


evaluation. 


These  shortfalls  have  not  gone  unnoticed  in  the  Army 
training  community.  A  El  was  tasked  in  1976  to  evaluate  the 
SEALTHAIH  system,  a  precursor  to  the  BILES  which  utilized 
only  optical  spottings  to  provide  "kill"  information.  In 
1977  and  1978,  tests  were  conducted  to  study  the  learning 
effect  of  this  system  upon  troops  in  training.  In 
constructing  these  tests,  Scott,  Beliza,  and  others 
effectively  pinpointed  the  necessary  elements  to  be  added  to 
the  training  system  in  order  to  obtain  statistically 
reliable  information  regarding  learning  effect.  [Refs. 
8,9,10,11] 

Their  methodology  for  eliminating  the  subjectivity  of 
traditional  Army  training  methods  consisted  of  a  four-fold 
approach:  better  determination  of  terminal  mission  outcome 

(mission  accomplishment)  through  the  use  of  hit/kill  systems 
(REALTRAIN  or  BILES) ;  the  elimination  of  the  vague  task 
descriptions  in  the  ABTEP  through  the  determination  of 
intermediate  subtasks  (top-down  analysis  of  combat 
processes) ;  the  use  of  dedicated  OPFOB  to  provide  realistic 
aggressors;  and  the  use  of  event-specific  trained  evaluators 
to  insure  standardized  evaluations.  [Ref.  8, p.1-4]  This 
methodology  will  be  examined  in  detail. 
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t .  la proved  Detarainatlon  of  Mission  Outcoae 

The  lack  of  aa  objective  aatbod  for  datarainiag 
aission  accoaplishaant  in  an  ABTEP  is  probably  the  prograa's 
biggest  weakness.  In  testing  the  effect  of  the  BEALTBAIH 


systea,  Scott,  Meliza,  at  al.,  agreed  that: 


"The  ABTEP  initially  suffered  froa  soae  critical 
weaknesses:  oge  was  the  inability  to  objectively  (Jeteraine 
tactical  aission  outcoaes.  However, the  introduction  of 
tactical  engageaent  siaulation  training  aethods  such  as 
SCOPES,  BBALTBAIR,  and  eventually,  the  Multiple  Integrated 
Laser  Engageaent  Systea  (MILES)  nas  alleviated  this 
problpa,  using  these  aethods,  coaaanders  have  the 
capability  to  conduct  two-sided,  free- play  tactical 
exercises  with  credible  casualty  assessaent  and  weapons 
signature  effects,  and  a  high  degree  of  realisa."  [fief. 
8:pg.  1] 


This  problea  can  then,  for  aost  practical  purposes  be 


considered  to  be  solved  if  units  engaged  in  training 


utilized  the  MILES  systea.  The  only  aajor  weakness 
reaaining  in  the  representation  of  weapons  effects  is  in  the 
play  of  indirect  fire,  as  the  effect  of  artillery  upon 
troops  during  training  still  cannot  be  adequately  siaulated. 
For  all  other  purposes,  assuaing  all  coabatant  eleaents 
possess  the  systea  during  training,  MILES  will  effectively 
deteraine  aission  outcome  just  as  real  battle  would  by 
deaonstrat ing  who- killed- who  in  coabat. 

2.  aiajjaiAga-gi-IaaasJftaJtt  itoaaak 

The  second  aajor  obstacle  to  effective  evaluation 
proved  to  be  lack  of  detail  concerning  the  coabat  processes: 
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"A  second  major  weakness  in  the  AHTEP  is  a  general 
superficiality,  which  results. in  inadequate  guidance  for 
Army  trainers... If  a  unit  fails  to  accomplish  its  mission, 
this  general  guidance  gives  the  trainer  no  help  in 
determining  reasons  for  failure."  [Bef.  S:pg.  1] 


In  order  to  measure  task  performance  accurately  more 


concrete,  identifiable  subtasks  had  to  be  generated  and 


measured.  These  were  defined  in  the  following  way: 


"Consistent  with  the  performance-oriented,  criterion- 
referenced  approach,  critical  intermediary  tasks  are 
defined  as  those  that  substantially  increase  the 
probability  of  mission  accomplishment. "  [Bef.  8:pg.  2] 


The  steps  taken  to  identify  these  tasks  were: 


"(a)  identification  of  candidate  intermediate  tasks; 

(b)  development  of  objective  measures  of  proficiency  for 
these  tasks; 

(c)  determination  of  the  test  conditions  necessary  to 
gather  these  data  reliably; 

(d)  correlation  of  intermediate  task  proficiency  with 
mission  outcomes; 

(e)  identification  of  those  tasks  which  correlate  most 
highly  with  mission  outcomes."  [Bef.  8:pg.  2] 


This  procedure  essentially  constituted  a  top-down  analysis 


of  the  given  mission,  in  this  case  a  squad  movement  to 


contact  (this  test  was  repeated  later  for  a  tank  platoon)  . 


The  key  point  here  is  that  once  sufficient  detail  regarding 


the  combat  processes  was  established,  measures  of 


effectiveness  for  each  subtask  could  be  devised  (see  Figure 


5) .  Thus,  accurate  identical  assessments  of  performance 


could  then  be  attained  for  each  replication.  This  forms  the 


basis  for  constructing  statistically  reliable  data;  as  much 


subjectivity  as  possible  has  been  eliminated  from  the  ABTEP 
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AT  PHASE  LIME  "A" 


17.  call  NCS  when  point  crosses 
phase  line  "A**. 

18.  Proa  phase  line  "A"  to  potential 
threat,  how  aany  tines  did  the  ©leaent 
leader  coanunicate  with  the  squad? 

19.  Are  3  or  aore  sen  in  your  eleaent 
within  10  aeters  of  one  another? 

20.  Nuaber  of  aen  in  your  eleaent  with 
which  your  eleaent  leader  has  visual 
contact.  'Enter  "x"  if  you  could 
not  observe.) 

21.  How  far  is  point  ahead  of  squad? 
(Enter  "x"  if  not  observed.) 

22.  Has  the  eleaent  leader  part  of  the 
point? 

23.  Is  point  aan  covered  by  at  least 
one  aan? 

24.  Nunber  of  aen  in  your  eleaent  aoving 
in  the  open.  (Enter  "x"  if  not 
observed.) 


nmrorntr 

TffuIESfniT 


TffSfBgfny 


Tae?eJ§n*r 

Yes  No  N/Obs 
(2)  (1)  (0) 

Yes  No  N/Obs 
(2)  (1)  (0) 

IluiB-df )  IxF 


Pigure  5:  An  Exaaple  of  Subtask  HOE's  for  a  Squad  Hission 

evaluation  by  the  use  of  subtasks.  (Dr.  Scott,  et  al, 

eventually  analyzed  this  data  using  Tukey's  HSD4  test  and 

constructed  standard  Analysis  of  Pariance  (ANOPA)  tables  to 

support  their  conclusions  [Ref.  8:pp.  153-154].)  The  value 

of  this  procedure  did  not  escape  the  personnel  at  ARI ; 

"The  payoff  froa  this  research  should  be  eapirical 
identification  and  validation  of  critical  interaediate 


I 


♦Tukey's  Honest  Significant  Difference  Test  (soaetiaes 
called  the  w  procedure).  This  is  a  aultiple  coaparison 
test.  It  is  designed  for  asking  all  pairwise  coapansons 
aaong  a  set  of  leans,  in  order  to  deteraine  which 
differences  are  significant. 
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tasks  as  well  as  deteraination  of  objective  aeasures 
These  aeasures  of  task  proficiency  and  aeasureaent 
procedures  can  be  incorporated  into  the  ABTEP. "[Hef . 


8:  P9 


3.  ikeJlaa-al  a.gsdisats^-2£Ea& 


In  order  to  provide  the  necessary  consistency  of 

I 

j 

response  to  the  tested  units  (squad,  platoon)  a  dedicated  j 


OPPOR  was  used  in  each  test  to  insure  the  opposition  would 
be  reasonably  constant.  This  gave  each  tested  unit  the  saae 
experience  and  allowed  the  aeasureaent  of  learning  effect 
between  RE ALTRAIN-trained  units  and  traditionally  (ARTEP 
only)  trained  units.  This  procedure  would  also  allow,  on  a 
large  scale  such  as  in  battalion  vs.  battalion  encounters, 
the  application  of  appropriate  OPFOB  tactics  to  training 
units.  This  effect  is  significant,  for  in  deciding  to 
establish  the  ETC  the  Aray  has  relied  heavily  on  Navy  and 


Air  Force  experience  with  the  use  of  trained  OPFOfi: 


"Moreover,  it  becaae  apparent  that  training  for  air-to-air 
coabat,  which  pitted  TIC  flyers  against  other  O.s.  pilots 
using  u. S.  tactics  in  identical  aircraft,  was  not  useful 
training  for  dogfights  with  North  Tietnaaese  HIG's.  The 
answer,  TAC  discovered,  was  to  establish  squadrons 
equipped  with  aircraft  which  reseabled  the  NIG  m  size  and 
operating  capability,  aanned  by  pilots  trained  in  Soviet- 
style  tactics.  ;he  0, s.  Navy  had  used  this  technique 
since  19§9,  and  its  pilots  so  trained,  out-perf oraed  TAC 
sixfold  In  ratio  of  kills  to  losses."  [Ref.  12:pg.  3] 

The  necessity  for  utilizing  a  dedicated  OPFOB  eaploying 


eneay  tactics  is  obvious  if  it  is  desired  to  duplicate  the 
"learning  effect"  of  coabat  (see  Figure  6) . 
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Figure  6:  The  Learning  Effect  of  Battle 


"The  battle  statistics  indicate  to  TAC  that  coebat  is  a 
powerful  trainer — whereas  American  pilots  in  their  first 
coebat  engageeent  have  had  only  a  40  percent  chance  of 
surviving,  by  their  tenth  engageeent  their  chances  of 
winning  had  increased  to  90  percent."  [Ref.  12:pg.  2] 


Therefore,  the  use  of  special  OPFOR  troops  in  evaluating 


training  for  os  units  is  not  a  luxury,  but  rather  a 


necessity:  it  duplicates,  as  nearly  as  possible,  the 


learning  effect  of  coebat  and  allows  for  the  replication  of 


training  exercises  so  that  training  progress  can  be 


statistically  eeasured. 


The  Use  of  Trained  Profgggianal_£valflhtors 

The  major  reason  for  the  use  of  trained  evaluators 
in  the  REALTRAIN  tests  was  to  insure  that  all  test 
procedures  and  scenarios  were  accurately  replicated  [  Bef . 
8:pg.  7].  The  use  of  such  evaluators  at  least  insures  a 
degree  of  consistency.  On  a  larger  scale,  the  use  of 
trained  evaluators  in  ABTEP  type  exercises  for  battalion 
sized  units  would  accomplish  the  same  thing,  i.e.  insure 
replicability,  but  also  prevent  the  other  major  weakness  of 
the  ABTEP  from  appearing:  peers  would  not  evaluate  elements 
of  like  skill  or  ability.  Bith  time  and  practice  through 
training,  even  a  junior  evaluator  could  accurately  report  on 
the  specific  tasks  for  which  he  is  trained,  thus  eliminating 
the  blind- leading  (evaluating) -the-blind  effect  common  to 
the  usual  ABTEP.  The  degree  of  evaluation  possible  under 
this  system  is  a  great  deal  more  incisive  than  that  of  the 
traditional  ABTEP  method. 

The  end  result  of  this  four-fold  approach  to 
improving  evaluation  is  the  shortfall:  the  amount  of  effort 
needed  to  bridge  the  gap  between  what  is  currently  available 
due  to  the  constraints  of  training,  and  what  is  necessary  to 
produce  a  statistically  reliable  evaluation  of  training. 
These  shortfalls  have  been  bridged  by  the  creation  of  the 
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National  Training  Center  (NTC) ,  for  all  the  elements 
indigenous  to  the  approach  used  by  ABI  are  contained  in  the 
structure  of  training  and  evaluation  conducted  at  the  NTC. 


This  is  an  exciting  fact,  for  it  establishes  a  statistically 
reliable  training  evaluation  for  the  first  tine  on  a  large- 
unit  scale,  k  background  disscussion  of  the  NTC's  technical 
capabilities  follows,  in  order  that  its  capacity  for 
significantly  iaproved  evaluation  nay  be  better  understood. 
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II.  THE  STATISTICAL  EVALUATION  OF  T H AIMING 

The  National  Training  Center  has  been  established  to 
train  the  heavy  battalion  task  force  in  sach  a  way  that  it 
cannot  be  done  at  the  unit  hoae  station.  To  achieve  this 
end  it  quite  rightly  relies  upon  the  train-evaluate-train 
model  of  learning  as  previously  discussed.  Although  MILES 
and  other  training  devices  undoubtedly  provide  a  quantum 
improvement  in  the  quality  of  training  at  the  NTC,  such 
devices  are  being  packaged  for  use  at  the  home  station.  The 
key  then,  to  the  uniqueness  of  the  NTC  lies  in  the  quality 
of  its  evaluation  process.  This,  in  effect,  separates  it 
from  the  usual  ARTEP  style  training  conducted  at  the  unit 
hone  station.  Given  the  essential  elements  of  proper 
tactical  training  evaluation  as  formulated  by  Scott,  Meliza, 
Banks  and  others  at  Arr,  can  the  NTC  provide  information 
about  the  tactical  performance  of  units  that  will  bear 
statistical  scrutiny? 

Indeed,  the  answer  to  this  question  must  te  /es,  for  the 
essential  methodology  used  by  ARI  to  evaluate  field  training 
exists  at  the  NTC.  A  hit/kill  system  to  accurately  reflect 
the  casualties  of  war  is  utilized  while  a  dedicated  OPFOR 
element  provides  realistic  opposition  to  the  friendly  unit. 
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A  cadre  of  trained,  professional  controller/evaluators 
provide  the  necessary  subjective  input  to  the  evaluation 
systes,  and  are  augaented  by  position  location  systeas  that 
are  aore  accurate  than  the  huaan  senses.  In  effect,  the 
aaount  of  inforaation  being  extracted  froa  a  unit  training 
session  is  sufficiently  reliable  at  this  point  to  provide 
the  basis  for  a  proper  training  (learning  effects) 
evaluation. 

&  coapleted  top-down  analysis  of  the  large  unit  coabat 
process  also  serves  to  provide  the  necessary  lattice  of 
subtasks  to  conduct  aeaningful  evaluations.  This 
"aeasureaent  of  evaluation"  aethodology  is  discussed  in 
detail  in  the  Appendices.  However,  the  existence  of 
reliable  data  does  not  insure  its  efficient  use;  a 
aethodology  aust  exist  in  order  to  utilize  this  data 
effectively  in  after-action  reviews  (AAR)  and  for  later 
provision  in  a  take-hoae  package  to  assist  unit  training. 

The  current  systea  of  NTC  feedback  as  designed  has  soae 
weaknesses . 

A.  PROVIDING  THE  BATTLEFIELD:  AN  OVERVIEW  OF  THE  NTC 

The  National  Training  center  concept  was  approved  in 
1977  to  fulfill  a  pressing  need  within  the  Aray.  Due  to 
rapid  advances  in  weaponry  the  Aray  in  the  late  1970* s  found 
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itself  unable  to  fully  exercise  units  to  their  maximum 
capabilities.  Bealistic  large-scale  live  fire  exercises 


becaae  impossible  due  to  the  range  of  new  weapons,  while  the 
use  of  full  electronic  warfare  (SB)  or 

cheaical/biological/radiological  (CBB)  capabilities  posed 
dangers  or  unacceptable  inconveniences  to  the  surrounding 
civilian  areas.  In  addition,  the  creation  of  standing  OPFOB 
units,  the  use  of  professional  training  evaluators  and  the 


integration  of  engagement  simulation  technologies  into  large 
scale  maneuvers  proved  to  be  prohibitively  expensive  if 
these  systems  were  to  be  deployed  at  individual  unit  home 
stations.  Thus,  in  order  to  provide  these  enhancements  to 
unit  training,  the  concept  of  having  a  national  Training 
Center  was  born ;  all  of  these  training  requirements  could  be 
incorporated  into  a  single  station  where  units  could  be 
rotated  to  in  order  to  train  properly  (see  Figure  7) . 


1. 


The  objective  of  the  NTC  is  to: 


"Provide  a  facility  where  heavy  battalion  task  forces, 
controlling  brigade  headquarters,  and  supporting  units  can 
undergo  essential  combat  arms  training  that  cannot  be 
accomplished  at  home  stations  due  to  physical  limitations 
and  prohibitive  cost  of  providing  a  realistic  training 
environment."  [Ref.  13:pg.  1] 


As  a  secondary  objective,  data  from  the  NTC  will  be  used  to 


improve  current  Army  procedures  and  assist  in  new  combat 
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RELATIONSHIP  OF  INCREASE  IN  ONIT  PROFICIENCY  TO 
EXERCISE  REALISB  WITH  CONSTRAINTS 


HIGH 


Collective 

unit 

Proficiency . 

A 


LON 

LON  ^  ,  HIGH 

Realism  of  exercise  environment 

Figure  7:  The  Increase  in  Proficiency  vs  Exercise  Realism 

developments  [Ref.  13:pg.  1 ].  Training  at  the  MTC  is  based 
on  the  "Train-Evaluate-Train  cycle",  with  emphasis  on  the 
feedback  to  units  to  provide  maximum  learning  and  to  assist 
in  later  home-station  follow-up  training.  The  training 
emphasis  is  placed  on  heavy  battalions  and  developing  their 
ability  to  "shoot,  move,  and  communicate."  To  this  end  the 
elements  of  the  training  environment  are: 
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0PP0  8 
EM 

Close  Air  Support 
Live  Fire  Exercises 
Engagement  Simulation  (BILES) 

Instrumentation  [Ref.  14:pg.  1-3] 

Although  instrumentation  is  heavily  relied  on  for  analysis 

of  the  exercises  and  for  providing  feedback  to  the  training 

units,  the  accomplishment  of  training  itself  is  paramount; 

"The  training  environment  will  be  paramount  at  the  NTC. 
Data  collection  will  be  secondary  to  accomplishing  unit 
training  objectives.**  [Bef.  13; pg.  2] 

The  evaluation  of  unit  training  at  the  NTC  will  be  in 

accordance  with  the  appropriate  ABTEP  with  concentration  on 

five  levels  of  activity  within  the  battalion  task  force: 

Execution 

Control 

Coordination 

Support 

Planning  [Ref.  14;pg.  1-5] 

The  structure  of  activity  for  training  units  at  the  NTC  is, 
however,  unique.  The  missions  to  be  performed  at  the  NTC 
are  drawn  from.  Army  doctrine  [Refs.  15,16,17]  and  a  complete 
list  is  provided  at  Appendix  A  [Ref.  18:  pp.  1-12,1-13], 

These  missions  (of  which  some  are  indicated  as  critical  and 
will  be  performed  by  all  units)  are  then  assembled  into  a 
tailored  package  of  scenarios  which  can  be  varied  in 
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intensity  to  natch  the  needs  of  the  training  battalion. 

Thus,  although  scenarios  and  intensities  are  pre-writtan  at 
the  NTC,  by  selecting  fron  a  "menu"  of  then  a  battalion 
connander  and  his  staff  can  tailor  their  training  at  the  NIC 
to  directly  neet  their  own  unique  needs. 

The  evaluation  of  units  training  at  the  NTC  will  be 
acconplished  by  the  integration  of  several  nethods. 
Basically,  they  can  be  classed  as  aonitering  nethods  using 
the  assistance  of  the  instrunented  battlefield  provided  at 
the  NTC,  and  the  traditional  observer  nethods  relying  on  the 
judgenent  of  observer/controller  personnel  acconpanying  the 
unit.  These  two  nethods  conplenent  each  other  to  a  high 
degree  and  interface  with  each  other  interactively.  The 
systen  serves  to  bridge  the  traditional  shortfall  between 
training  constraints  and  evaluation  necessities  and  provides 
data  which  can  be  utilized  in  the  statistical  evaluation  of 
tactical  perfornance. 


The  top-down  analysis  technique  was  prescribed  in 
1979  as  the  nethodology  to  be  used  in  determining  the 
Measures  of  Effectiveness  (HOE)  ,  Measures  of  Perfornance 
(HOP)  ,  and  Essential  Elements  of  Analysis  (SEA)  that  would 
conprise  the  NTC's  evaluation  progran  [Be f  14:pg  III-5J. 
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The  method,  generally  described,  is: 


"Top-Down  Analysis.  The  technique  is  to  asseable 
appropriate  data  sources  to  deteraine  in  the  broadest 
context  the  aissions  of  each  systea  (maneuver,  indirect 
fire,  engineer).  The  systea's  aissions  are  then 
decoaposed  into  progressively  lower  subdivisions  until 

fuantltative  aeasures  can  be  applied  directly."  [Ref 
4  :pg.  III-5] 


This  analysis,  however,  specifies  no  standards.  The  intent 


of  it  is  to  produce  a  listing  of  quantitative  aeasures  which 


can  be  used  to  conduct  unit  evaluations.  This  listing  will 


later  fora  the  Lasis  for  the  actual  evaluation  of  training 


standards  for  large  units. 


"The  aajor  departure  froa  the  aodel  used  in  ARTEP 
development  is  that  th?  MOE/MOP  model  identifies 
aeasureable  elements  without  imposing  a  standard. ...  the 
aeasures  are  quantitative  not  qualitative.  The 
qualitative  assessment  will  be  applied  after  the 
development  of  quantitative  aeasures."  [Ref  14:pg.  III-5  ] 


The  hierarchy  for  this  procedure  is  shown  at  Figure  8. 


The  definitions  for  these  items  contained  within  the 


pyramid  are  at  Appendix  B.  The  procedure  here  is  the  same 


one  as  used  by  Scott,  Heliza,  and  BanJcs  to  produce  the 


statistically  reliable  RE  ALT  BA  IB  results  [Refs.  8,9,10,11]. 


The  task  of  performing  the  top-down  analysis  of  HOEs 


for  the  BTC  fell  to  the  Combined  Arms  Center  (CAC)  at  Ft. 


Leavenworth  in  1979.  Analysis  began  there  under  the 


auspecies  of  the  Combined  Arms  Training  Development  Activity 


(CATRADA),  Unit  Training  Directorate  (DTD). 
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The  final  ESA  selected  for  use  in  further  subtasking  were: 

Maneuver 

Intelligence 

Air  Defense  Artillery 

Mobility-Counter  Mobility 

Coabat  service  Support 

Fire  Support 

Nuclear- Biological-Cheaical 

Coaaand,  Coaaunications,  and  Control  [  Bef  16: pg.  3-11] 


Pigure  6:  The  Top-Down  Analysis  Hierarchy 

For  a  discussion  of  the  analysis  process  which  resulted  in 
these  EEA,  see  Appendix  C.  These  eight  SEA  accurately 
reflect  the  coabat  process  of  the  heavy  battalion  Task  Force 
(TF)  . 
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With  the  identification  of  the  eight  ESI ,  the  Onit 

Training  Directorate  at  CATBADA  turned  to  the  task  of 

selecting  those  HOE/BOP  which  would  support  the  evaluation 

of  unit  tactical  perforaance  under  the  EEA.  Within  the 

TBADOC  coaaunity  a  HOE  is  defined  as: 

"A  aeasure  of  effectiveness  is  a  quantitative  indicator  of 
the  ability  of  a  huaan,  huaan/aateriel,  or  aateriel  system 
to  acconplish  the  task  for  which  it  was  designed.  For  a 
military  force,  it  is  a  aeasure  of  the  ability  of  the 
force  to  accoaplish  its  coabat  mission."  [Bex  19:pg.  25] 

The  ideal  HOB  should  aeasure  directly  the  degree  toward 

which  a  particular  EEA  contributes  to  the  aission 

accomplishment  [Bef  20;pg.  29].  As  the  HOE  is  a  aeasure  of 

soae  quantity,  it  should  be  considered  in  light  of  the  four 

measurement  scales.  For  a  discussion  of  these  four  scales 

see  Appendix  D. 

CATBADA  developed  a  unigue  aethodology  to  assist 
thea  in  coapleting  this  portion  of  the  subtasking  analysis. 
This  aethodology  is  described  in  detail  in  Appendix  E. 

The  culaination  of  this  process  was  a  series  of 
EEAs,  HOEs,  and  HOPS  which  for  the  first  tine  accurately 
reflected  the  heavy  battalion  coabat  process.  This 
subtasking  analysis  was  then  used  to  define  the  paraaeters 
of  the  planned  ETC  instruaentation  systea.  As  CATBADA  now 
had  a  reasonably  clear  picture  of  the  tasks  to  be  undertaken 
by  battalions,  the  instruaented  battlefield--designed  to 
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measure  the  accomplishment  of  these  tasks— could  now  be 
created. 

The  data  collection  process  at  the  NTC  will  be 
extensive  and  coaplex.  Data  will  be  gathered  froa  live-fire 
as  well  as  force-on-force  engagement  siaulations.  Inputs  to 
the  data  collection  center  will  be  aade  in  several  foras: 
video  recording  of  events;  radio  aessages  and  data  supplied 
by  field  controllers;  aonitering  and  recording  of  radio 
nets;  and  inforaation  received  via  the  instrumented 
environaent.  The  basic  instruaentation  concept  is 
illustrated  in  Figure  9. 

The  Core  Instruaentation  Subsystem  (CIS)  is  the 
computer  recording  center.  The  CIS  receives  all  data  inputs 
and  serves  as  the  operating  area  for  the  Exercise  Management 
and  Control  (EMC)  teaas  and  Training  Analysis  and  Feedback 
(TAF)  teams.  Antennas  selectively  located  throughout  the 
maneuver  area  provide  the  necessary  links  between  the  field 
instrumented  exercise  areas  and  the  CIS.  The  live-fire 
exercise  area  is  also  instrumented  to  record  battle  data. 

NTC  phase  I  instrumentation  will  consist  of  the 
components  shown  in  Figure  10.  Ihe  CIS  is  the  central 
computer  facility  that  provides  all  real-time  data 
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Figure  9:  Pictorial  Diagram  of  me  Instrumentation  System 


processing  and  interactive  displays  necessary  to  monitor, 
command,  control  and  evaluate  the  training  in  all  the  me 
exercise  areas.  The  Bangs  Data  Measurement  Subsystem  (ROBS) 
provides  real-tine  position  location  and  engagesent  event 
data  for  all  instraaented  players.  The  Bangs  Monitoring  and 
Control  subsystem  (BBCS)  includes  autoaated  and  human 
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Figure  10:  NTC  Phase  I  Instrumentation  System  Architecture 

sensors  (field  controllers)  with  coeeunication  links  to  the 
CIS;  this  provides  the  leans  of  ooni taring  and  controlling 
all  activities  in  the  NTC  training  area.  A  Digital 
Interface  component  (DIC)  provides  the  input/output  link  for 
all  digital  data  communications  between  the  CIS  and  the  RDHS 
and  RtfCS.  (A  more  thorough  discussion  of  the  component 
functions  is  provided  in  Reference  18,  pp.  1-14  to  1-21.) 
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Bach  subsystem  has  its  own  capabilities  and 
functional  requirements.  Data  gathered  by  the  RDHS  and  RHCS 
is  transmitted  to  the  QIC.  The  Die  performs  all  electronic 


signal  and  data  transformations  required  to  provide  the 
transmitted  data  to  the  CIS  in  useable  fora.  The  CIS  then 
processes  and  displays  the  data  as  necessary  for  analysis, 
evaluation  and  decision  making.  Personnel  in  the  CIS  can 
control  the  exercises  by  transmitting  messages  through  the 
DIC  to  the  RHCS.  An  illustration  of  the  data  flow  and 
control  links  is  given  in  Pigure  11. 

Initial  instrumentation  at  HTC  consists  of  equipment 
already  tested  and  in  use  by  various  Army  experimentation 
and  testing  agencies.  This  equipment  includes  the  HI LBS 
devices  for  casualty  assessment  and  instrumentation  to 
record  position  location,  event  occurrences  (such  as  firings 
and  radio  transmissions)  for  125  player  items.  Larger 
weapons  such  as  tanks  and  TOHs  will  be  fully  instrumented 
and  also  interact  with  HUES.  Future  expansion  will 
instrument  500  players,  record  events  in  more  detail  and 
will  also  include  activities  at  fire  direction  centers, 
command  posts  and  tactical  air  support  control  points  as 
well  as  individual  players. 
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Figure  11:  NTC  Instrumentation  System  Interfaces 


There  are  aultiple  capabilities  contained  in  the 
Phase  1  instrumentation  package.  Various  devices  will  input 
quantifiable  data  to  the  CIS.  An  example  of  this  data 
includes  tiae  of  weapon  firing  (each  weapon  recorded 
individually);  whether  a  firing  was  a  hit  or  aiss;  if  a  hit 
is  generated,  the  individual  hit  is  identifed  and  the  degree 
of  daaage  recorded;  the  positions  of  both  players;  and  auch 
aore.  A  disscussion  of  the  actual  quantities  being  measured 
by  the  HTC  instrumentation  is  provided  at  Appendix  F. 

The  CIS  software  is  prograaned  to  tabulate  and 
compute  such  relevant  information  as:  number  of  rounds  fired 
by  each  weapon  system,  weapon  type,  unit,  etc.;  number  of 
enemy  kills,  by  each  weapon  and  type;  range  of  engagements; 
and  auch  other  useful  information.  This  data  is  then 
manipulated  into  various  foraats  to  determine  the  statistics 
used  for  unit  evaluation:  aoveaent  rate;  weapons 
proficiency  based  on  the  number  of  rounds  fired  to  kill  the 
number  of  enemy  targets;  and  so  forth.  A  complete 
delineation  of  all  statistical  compilations  currently 
planned  for  the  NTC  is  provided  at  Appendix  G. 

The  instrumentation  has  two  other  important 
capabilities  worth  noting.  In  excess  of  20  different  radio 
nets  will  be  completely  recorded  during  exercise  periods 
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which  will  provide  a  weans  of  checking  key  events,  and  there 
will  be  6  video  teaas  at  various  locations  around  the 
battlefield  to  fila  the  actual  exercises.  The  entire 
operating  systea  is  extreaely  coaplex  and  will  undergo 
iaproveaent  as  experience  is  gained  at  the  ETC.  is  with  any 
coaplex  systea,  however,  there  are  liaitations  to  the 
guantif ication  capabilities  of  the  NTC .  These  liaitations 
are  discussed  fully  at  Appendix  H. 

All  data  will  be  recorded  in  the  CIS  for  evaluation, 
and  in  such  detail  that  each  training  eleaent's  operations 
can  be  exaained  as  a  separate  entity  down  to  the  individual 
firing  platforas.  To  assist  in  overall  unit  assessaent  the 
data  can  be  coapiled  and  aggregated  to  produce  battalion 
level  statistics  for  whatever  period  is  desired.  The 
display  fornats  and  data  aanipulation  capabilities  are 
extreaely  flexible  and  allow  a  user  to  alter  the  foraax  of 
the  desired  statistics  (For  a  aore  detailed  discussion  of 
eguipnent  capabilities  and  interface  devices  see  Reference 
18)  . 

B.  THE  CONCEPT  OF  STATISTICAL  EVALUATION 

In  discarding  the  old  ATP/ATT  systea  the  Army 
effectively  did  away  with  unit  "grading*’ .  This  certainly 
was  a  wise  decision,  for  the  grading  systea  of  the  ATT  was 


abused  badly.  Coaaanders  often  "stacked"  the  deck  by 
managing  crews  and  eleaents  to  avoid  testing  poor  performers 
in  order  to  obtain  good  grades.  Other  coaaanders  unfairly 
used  the  grade  results  to  deal  out  "punishaent"  in  one  fora 
or  another  to  poor  performers.  The  ABTEP  philosophy  of 
evaluation  (and  subsequent  re- training  and  improvement) 
without  grading  is  sound  and  must  be  maintained.  Any  such 
proposed  aethodology  must  avoid  the  appearance  of  a  "report 
card"  or  a  comparison  between  specific  units. 

Yet  clearly,  there  aust  be  a  fora  of  differentiating 
performance.  "Mission  accomplishment  is  too  vague  a 
criteria,  for  certainly  a  unit  which  "takes  the  hill"  with 
851  casualties  has  accoaplished  its  aission  just  as  surely 
as  one  which  "takes  the  hill"  with  20*  casualties.  The 
Aray,  however,  must  discriainate  between  the  trained  and  the 
untrained;  two  such  units  obviously  differ  (all  other 
factors  being  equal)  in  their  acquired  combat  skills.  This 
problem  refers  back  to  the  major  weakness  of  the  ARTEP 
itself:  the  lack  of  a  quantifiable  standard  for  evaluating 
the  tactical  performance  of  large  units.  In  order  to 
quantify  such  an  evaluation,  some  sort  of  aeasureable 
standard  (not  a  grade)  becoaes  necessary — be  it  percent 
casualties,  loss-exchange  ratios,  targets  killed  per  rounds 
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expended,  or  soae  other  such  Measure  of  effectiveness.  Any 
program  whic'  serves  to  clarify  these  parameters  will 
ultiaately  help  to  refine  the  AHTEP  itself  into  a  aore 
useful  document. 

1.  Evaluation  Mithout_srading 

Fortunately,  there  exists  such  a  methodology  for 
examining  performance.  In  academic  circles  during  the  early 
1960's  methods  were  devised  to  test  students  on  their 
intrinsic  academic  skills,  without  tying  such  an  evaluation 
to  a  series  of  grades,  dost  students  are  familiar  with 
these  results;  the  Scholastic  Aptitude  Tests  (SAT) ,  various 
College  Entrance  Examination  Board  (CEEB)  tests,  the 
Graduate  Record  Exam  (GEE)  ,  and  in  the  public  schools  the 
Iowa  Test  of  Basic  Skills  (ITBS) ,  all  utilize  essentially 
the  same  concept  in  evaluation,  and  it  is  a  simple  one. 
Basically,  the  idea  is  that  a  student's  performance — based 
on  the  numerical  outcome  of  a  given  test — can  be  compared  to 
a  large,  anonymous  population  (in  effect,  a  normal 
population),  and  using  the  method  of  z-scores,  t-scores, 
stanines,  or  any  one  of  several  statistical  methodologies,  a 
percentile  rating  can  be  calculated  for  the  individual's 
performance  in  that  skill  area.  Thus,  instead  of  being  told 
he  received  a  "B"  in  mathematics,  a  student  is  told  he  falls 
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in  the  80th  percentile  for  his  age  group — a  auch  sore 
aeaningful  assessment,  for  it  tells  the  individual  his 
relative  skill  as  it  relates  to  his  peer  group.9 

This  method  has  long  been  employed  in  the  OS 
military  to  classify  soldiers  for  service  potential,  which 
is  a  situation  where  grading  has  little  or  no  usefulness. 

In  a  similar  fashion  it  could  be  used  to  relate  tactical 
proficiency  of  a  unit  to  its  commander  and  staff  without 
resorting  to  any  grades  or  unit  comparisons.  Certainly  an 
evaluation  such  as  nyou  took  the  hill  and  suffered  20 % 
casualties;  this  performance  falls  in  the  84th  percentile  of 
all  units  who  have  accomplished  this  training  objective"  is 
more  informative  to  a  commander  than  a  brusque  "you  took 
the  hill  and  lost  20%  of  your  force."  One  statement  relates 
a  degree  of  accomplishment,  while  the  other  provides  no  hint 
regarding  whether  or  not  20%  casualties  was  historically 
excessive  for  this  operation.* 


*It  must  be  stressed  here  that  this  is  an  anonymous  peer 
group.  No  comparison  of  "Jinny  vs  Johnny"  is  implied,  or, 
m  fact,  is  even  possible  under  this  methodology. 

•Indeed,  the  STC  development  plan  [Ref.  14]  requires  the 
determination  of  quantified  (historical)  standards  for  each 
scenario,  and  states  that: 

"A  secondary  objective  will  be  to  define 
baseline  (norm  Eased)  standards  (for  scenarios) 
by  trend  analysis  of  the  data  base."  [Ref. 

14:pg.  ill-IOj 

This  has  not  been  accomplished  as  yet. 
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Other  benefits  accrue  automatically  from  such  an 
evaluation.  Using  a  data  base  of  these  evaluations,  it 
would  be  possible  to  analyze  thee  for  inherent  doctrinal 
weaknesses;  for  example,  if  a  particular  operation  yields 
excessive  casualties  repeatedly,  it  may  be  determined  that 
this  particular  combat  skill  needs  greater  emphasis 
throughout  the  Army,  or  that  our  doctrinal  approach  to  the 
problen  is  flawed.  Further  side  effects  of  such  an 
evaluation  system  would  be  increased  insight  into  the  combat 
process,  and  ultimately  an  enhanced  ABTEP~one  containing 
nore  specific  evaluation  criteria  which  could  ultimately 
save  lives  in  combat. 

The  Training  fieadiness  Profile  (TBP)  about  to  be 

proposed  here  would  provide  a  vehicle  whereby  a  unit 

evaluation  could  be  constructed  in  a  non-competitive  manner 

without  resorting  to  grades.  Indeed,  any  other  sort  of 

historical  comparison  is  expressly  forbidden: 

"Unit  evaluations  will  be  for  the  sole  purpose  of 
facilitating  remedial  training  of  the  unit.  There  will  be 
no  unit  comparative  scores  or  scoreboards. "[Bef.  13:pg.  2] 

The  TBP  would  be  simple,  small,  easy  to  read,  and  hopefully 

more  informative  to  a  battalion  commander  and  his  staff  than 

a  series  of  bare  statistics  presented  in  a  disjoint  fashion 
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at  an  after  action  review  (AAB)  .  The  TBP  coaid  begin  with  a 
chart  depicting  overall  aission  accoaplishaent  in  a 
percentile  fashion  calculated  for  each  aajor  coabat  aission 
(Appendix  A)  conducted  while  training  at  the  BTC.  This  itea 
would  provide  a  basic  overview  of  the  unit's  tactical 
performance  across  the  board.  Following  aission 
accoaplishaent ,  pages  depicting  the  unit's  ability  to  shoot, 
move,  and  coaaunicate  in  each  training  mission  would  be 
displayed.  Pinally,  feedback  froa  the  observer/controller 
evaluations  could  be  portrayed  followed  by  pertinent 
coaaents  froa  the  BHC/TAP  personnel,  the  Coaaander  of  the 
NTC,  and  other  individuals  so  tasked  to  provide  a  unit 
evaluation.  These  coaaents  would  serve  to  counterbalance 
and  augment  the  machine  generated  statistics  and  introduce  a 
human  (albeit  more  subjective)  evaluation  of  unit 
performance. 

Such  a  document  fills  a  need  in  the  currently 
planned  system  of  evaluation  and  feedback  at  the  NTC.  The 
after  action  review  (AAB)  methodology  now  planned  for  the 
NTC  is  somewhat  incomplete;  although  it  is  efficient  in 
reflecting  what  happened  during  a  training  exercise,  and 
provides  some  insight  into  why  such  things  happened,  it  does 
not  convey  degree  of  performance  to  the  commander — how  well 
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he  did  is  left  for  the  commander  to  surmise  on  his  own.'  Any 
allocation  of  training  resources  at  the  hoae  station 
following  an  NTC  training  cycle  is  then  done  based  on  his 
perception  of  what  was  acceptable  or  unacceptable  and  any 
linkage  between  certain  levels  of  perforaance  and  his 
overall  unit  mission  accoaplishaent  is  left  to  the 
coaaander's  own  insight.  This  is  perhaps  not  the  most 
efficient  use  of  the  data  generated  at  the  NTC.  In  all 
likelihood,  a  battalion  commander  and  his  staff  will  only  go 
through  an  NTC  training  cycle  once  together  (planned 
rotation  cycle  is  every  18  months  for  each  battalion  at  the 
NTC) .  In  order  to  capitalize  on  the  experience  and  improve 
the  conduct  of  home  station  training,  soae  degree  of 
relative  importance  must  be  attached  to  training 
deficiencies  highlighted  by  the  NTC  exercise.  The  proposed 
TRP  does  this  in  a  concise  and  econoaical  way,  for  a 
commander  whose  unit  performed  in  the  20th  percentile  for 
coaaunications  procedures  in  the  hasty  attack  and  suffered 
correspondingly  high  casualties  while  reaaining  in  the  80th 
percentile  for  other  HOBs  can  draw  a  conclusion  such  more 


▼In  conversation  with  EHC/TAF  personnel  at  the  NTC, 
there  was  no  indication  that  the  initial  standards  had  yet 
been  generated  for  scenarios  as  reguired  by  the  NTC 
Development  Plan  faef.  14:pp.  Ill- 7  to  HIM  1J.  This 
perception  could  be  erroneous,  but  even  so,  the  TRP  would 
provide  an  automatic  methodology  to  implement  these 
instructions. 
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accurately  than  a  coe Bander  who  is  only  given  a  nuserical 
susaary  of  coaaunication  transmissions  without  knowing  the 
iapact  or  whether  the  nuaber  of  tranaissions  was  excessive. 
Accordingly,  the  first  coaaander  who  has  availible  for  his 
use  a  percentile  standing  knows  his  unit  is  below  the  aean 
(average)  in  this  area  and  can  focus  his  efforts  to  reaedy 
this  shortcoaing.  The  second  coaaander  only  knows  he 
suffered  a  large  nuaber  of  casualties  and  likewise  knows  the 
nuaber  of  radio  transmissions  made,  but  he  does  not  have  the 
obvious  link  between  the  two  facts  since  no  indicator  of 
average  performance  is  provided. 

Thus,  the  THP  possesses  several  advantages  (which 
will  be  exaained  in  detail  later) .  It  reflects  true  unit 
readiness,  that  is,  it  applies  a  relative  standing  within 
the  peer  group  to  specific  training  performance.  Using  this 
method,  if  one  desired,  true  aggregated  readiness  statistics 
could  be  generated  for  units  within  the  Aray  that  would 
reflect  a  coaaon  assessment.  The  proposed  format  is 
designed  to  be  easy  to  understand  and  would  not  require 
excessive  statistical  reports.  Virtually  all  officers 
should  be  readily  faailiar  with  normal  score  percentiles,  as 
all  college  entrance  exaa  results  are  in  this  foraat.  The 
TBP  would  also  be  a  true  resource  allocation  tool— dt  would 
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demonstrate  the  need  for  remedial  training  clearly  and 
provide  an  easy  method  for  linking  cause  (training 
deficiency)  and  effect  (casualties)  . 

Finally,  given  a  large  enough  population  for 
examination,  the  TBP  could  be  used  to  set  defacto  standards 
for  the  IB TBP .  After  the  data  base  has  become  sufficiently 
large  to  permit  the  assumption  of  normality,  statistical 
tools  could  be  applied  to  such  information  to  yield 
quantifiable  standards  in  unit  training.  This  could  improve 
the  ABTBP  and  yield  an  even  greater  benefit  to  the  Army. 

In  this  document  the  methodology  used  to  establish 
the  current  subtasks  in  use  at  the  HTC  will  be  examined,  and 
changes  proposed  to  permit  the  generation  of  a  TBP.  The 

theory  behind  '-onstracting  the  TBP  will  be  discussed  and 

followed  with  a  sample  TBP  for  examination.  Lastly,  a 

discussion  of  the  possible  growth  and  implementation  of  this 

system  will  be  followed  by  a  series  of  recommendations  and 
conclusions  regarding  the  TBP  system.  In  total  then,  this 
document  shall  demonstrate  an  improved  methodology  for  the 
evaluation  of  unit  tactical  proficiency  at  the  Rational 
Training  center. 
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III.  THE  BEAS BEEBE NT  OF  .IBAINIBS  ACHIEVEMENT 

The  key,  as  stated  previously,  to  the  uniqueness  of  the 
National  Training  Center  experience  lies  in  the  quality  of 
its  evaluation  process.  First  and  foreeost  the  NTC  exists 
to  provide  training  to  the  heavy  battalion  task  force. 
However,  in  using  the  "Train-Evaluate-Train"  cycle  the 
advantage  of  training  at  the  NTC  can  be  squandered  if  the 
feedback  process— the  evaluation  stage--  is  inadequate  to 
the  task.  In  order  to  capitalize  upon  the  first-rate 
training  opportunity  provided,  the  aost  effective  use  aust 
be  aade  of  the  statistically  reliable  data  being  taken  froa 
the  instruaented  training  environaent. 

The  purpose  of  the  TBP  is  to  provide  an  objective 
noraative  evaluation  of  unit  training  perforaance.  This 
aethod  is  the  best  solution  currently  available  to  the 
problea  of  evaluating  training  standards  for  large  units. 

The  TBP  will  be  generated  for  each  exercise  segaent,  which 
is  generally  coaprised  of  one  aission  (see  Appendix  A) .  Any 
evaluation  to  be  conducted  aust  be  based  on  aeasures 
concerning  the  activities  that  transpired  during  the 
segaent.  Since  these  aeasures  are  being  coapiled  in  order 
to  produce  an  objective  evaluation,  the  aeasures  theaselves 
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■ust  be  objective.  The  goal/  therefore,  is  to  develop  a  set 
of  objective  measures  that  reflect  overall  training 
perforaance.  Is  defined  by  TBADOC,  an  HOB  is  a  quantitative 
indicator  of  the  ability  of  a  ailitary  force  to  accomplish 
its  coabat  aission  [Bef.  19: pg.  25].  The  issue  now  at  hand 
is  to  deteraine  and  define  a  set  of  HOEs  that  aeet  these 
requirements. 

Any  set  of  HOEs  that  satisfy  the  above  restrictions 
could  be  used  to  produce  an  objective  training  evaluation. 
There  is  no  unique  set  that  is  optiaal,  but  certain  measures 
are  generally  considered  to  be  "better"  than  others  in 
providing  a  basis  for  assessment.  The  collective  set  of 
HOEs  should  reflect  overall  unit  effectiveness  and  not  just 
a  series  of  disjoint  "snap-shot"  looks  at  specific  areas  of 
perforaance  (i.e.,  the  set  aust  cover  the  full  spectrua  of 
perforaance  to  ne  evaluated) .  The  HOEs  should  be  defined  in 
such  a  way  that  different  beginning  force  strengths  and 
capabilities  are  accounted  for  in  the  resulting  number,  i.e. 
the  measure  should  be  "normalized".  Percentages  provide 
this  noraalizing  factor,  but  interpretation  or  coaparison  of 
percentages  can  be  aisleading  if  the  actual  inputs  to  the 
percentage  coaputation  are  not  available.  In  aost  instances 
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a  larger  nuaber  is  associated  with  being  better  so  the 
measures  should  be  defined  with  this  in  aind. 

The  NTC  collects  an  array  of  objective  data  froa 
training  exercise  activities.  The  collected  data  and 
resulting  statistics  have  foraed  the  basis  for  developing  a 
set  of  HOEs  that  can  be  used  to  provide  an  objective 
evaluation  of  the  unit's  training  performance.  The 
reaainder  of  this  section  will  present  a  set  of  HOEs  that 
provide  a  broad  coverage  of  the  unit  activities.  HOEs  fit 
into  the  current  stucture  of  analysis  categories  at  the  NTC: 
aissian  ascowRlisfaigas;  akggt;  and  sgaagaisate. 

Collectively,  the  HOEs  yield  an  overall  assessment  of  the 
unit's  performance.  Where  percentages  are  used  to  normalize 
portions  of  the  data,  the  actual  numbers  used  in  the 
computation  will  be  given.  In  all  cases,  except  where 
specifically  noted,  a  larger  nuaber  represents  a  higher 
level  of  performance. 

A.  HISSION  ACCOHPLIS HHENT 

k  tactical  mission  is  a  tasking  to  perform  a  specific 
function,  i.e,  attack,  defend,  etc.  (see  Appendix  A).  Other 
instructions  in  the  mission  usually  include  such  details  as 
when,  where,  or  why  the  task  is  to  be  accomplished.  There 
is  no  single  3et  of  guidelines  or  standards  that  can  be  used 
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to  judge  whether  or  not  an  assigned  aission  was  successfully 
perforaed.  In  some  cases  this  leads  to  a  somewhat  aabiguous 
and  subjective  process  in  deteraining  success  or  failure  for 
a  aission.  However,  there  are  general  areas  of  agreeaent 
when  assessing  aission  performance.  These  areas  are  as 
follows:  the  friendly  force  aust  have  enough  survivors  to 
continue  operations;  the  enemy  force  aust  be  destroyed  or 
weakened  to  haaper  further  operations;  and,  if  a  tiae  is 
specified  for  an  operation,  it  aust  be  set.  All  of  the 
following  proposed  HOEs  were  developed  so  as  to  provide 
flexibility  in  interpretation  in  these  areas  without 
iaposing  a  predeterained  standard  of  acceptable  performance. 
Individually,  the  following  BOEs  provide  an  assessaent  of 
unit  perforaance  in  a  liaited  view,  but  collectively  they 
represent  the  measures  necessary  to  evaluate  overall  unit 
perforaance. 

This  is  the  percentage  of  OPFOB  coabat  vehicles  that 
are  killed  by  friendly  weapons  . 

#  of  OPPOfi  coabat  vehicles  killed 

POVK  * - X  100 

#  of  OPFOB  coabat  vehicles  in 

initial  force 

This  is  a  direct  measure  of  the  mobility  and  firepower  loss 
suffered  by  the  eneay.  It  addresses  the  effectiveness  of 
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the  friendly  force  in  directing  fire  at  and/or  destroying 
eneay  vehicles.  Since  a  percentage  is  used  here  the  aeasure 
reflects  loss  relative  to  a  particular  starting  strength. 


2.  Percent  OP  FOR  I 


This  is  the  percentage  of  OPFOB  personnel  that 

becoee  casualties. 

*  of  QPFOR  personnel  killed 
*  of  OPFOB  personnel  in  initial  force 

This  is  a  direct  aeasure  of  friendly  killing  power 

effectiveness  and  reflects  the  loss  strength  suffered  by  the 

eneay.  "(This)  aeasure  is  used  to  evaluate  total  force 

effectiveness  when  destruction  of  the  opposing  force  is  the 

priaary  aissicn  of  both  sides."  [Bef.  21:pg.  4-43] 


This  is  the  percentage  of  the  total  value  of  the 
OPFOB  that  is  killed  by  the  friendly  force  during  the 
exercise  segaent. 


L(#  of  type  "i"  OPFOB  targets  killed) 

X  (value  of  target  type  "i") 

polv  - - - - - - - - - - x  100 

value  of  initial  OPFOB  unit 


The  value  of  each  OPFOB  type  is  provided  in  the  weighted 


effectiveness  index  (HEI/WOV)  table  stored  in  the  CIS  (see 


Figure  22,  Appendix  G) .  This  aeasure  coabines  the 


heterogeneous  force  structure  of  the  OPFOB  in  a  fashion  that 
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reflects  the  total  fighting  capability  of  the  OPPOB  that  was 
destroyed.  The  eneay  usually  does  everything  possible  to 
thwart  the  accomplishment  of  the  friendly  force  mission. 

This  is  a  weighted  measure  which  depicts  the  amount  of  enemy 
combat  power  destroyed  by  the  friendly  force. 

<*.  Percent  _Pxiendly.-!Lgki£lea-SiitYlysd-.ie£g£L 

The  percentage  of  friendly  combat  vehicles  that  are 
not  killed  by  enemy  fire. 

#  of  friendly  combat  vehicles 

surviving  battle 

PPVS  - - X  100 

*  of  friendly  combat  vehicles 

in  initial  force 

This  HOE  is  widely  used  to  provide  a  direct  measure  of  the 
survivability  of  the  friendly  force.  It  is  an  indicator  of 
how  well  the  friendly  force  used  available  terrain  to  mask 
movement  and  protect  vehicle  positions.  A  unit's  mobility 
is  highly  important  in  the  battle  area.  This  measure 
reflects  how  well  the  friendly  force  was  able  to  utilize  its 
mobility  and  conserve  its  combat  power. 

5.  Percent  _PxiendlY_Psc.sfisngl-£ii£vlv£i-l£££SL 

This  is  the  percentage  of  friendly  personnel  who 
survive  the  battle. 


#  of  friendly  personnel  alive 
at  end  or  battle 

PPPS  * - X  100 

*  of  friendly  personnel  in 
initial  force 
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This  is  an  iaportant  aeasure  which  indicates  whether  or  not 
a  force  is  capable  of  continuing  operations.  Successful 
aission  accoaplishaent  is  highly  guestionable  if  the 
friendly  force  is  reduced  to  a  negligible  strength  during  a 
battle.  This  MOE  reflects  how  well  the  friendly  force 
avoided  eneay  fire  and  is  an  indicator  of  the  unit's  ability 
to  properly  execute  sound  tactical  plans  and  conserve  the 
lives  of  its  soldiers. 
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7.  Mian?  9  lass  .SKbaagg-S^ig-iaiiSgl 

This  is  the  proportion  of  OPFOB  losses  divided  by 
the  proportion  of  friendly  losses. 

(  POL?  ) 

RLER  =  - 

100- (  PFSV  ) 

The  seasore  will  be  a  pure  number  that  compares  the  relative 
value  of  the  losses  suffered  by  both  sides.  The  relative 
loss  exchange  ratio  is  a  seasure  of  friendly  effectiveness 
taking  two  major  factors  into  consideration.  The  numerator 
reflects  the  destructive  capability  of  friendly  weapons. 

The  denominator  is  a  reflection  of  the  ability  of  the 
friendly  force  to  survive,  A  combination  of  these  factors 
in  a  ratio  approaches  an  overall  indication  of  friendly 
force  combat  effectiveness.  [Ref.  21:pg.  4-22] 

This  measures  the  total  elapsed  time  from  uojinning 
to  completion  of  a  mission. 

T1H  ■  (v  ision  end  time)  -  (mission  begin  tine) 

As  a  stand  alone  seasure  this  HOE  would  not  be  very  useful. 
However,  when  a  time  is  specified  for  a  particular  mission 
this  measure  becomes  vitally  important.  Even  if  a  time  is 
not  specifically  stated  this  HOE  can  reveal  deficiencies  in 
planning,  movement,  and  overall  mission  execution.  For  this 
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aeasure,  the  stated  aission  vill  dictate  whether  a  large  or 
saall  nuaber  is  better.  In  an  attack  the  friendly  force 
wants  to  capture  an  objective  quickly  before  the  eneay  can 
block  the  advance.  For  a  delay  or  defense  the  friendly 
force  aias  at  holding  back  the  eneay  as  such  as  possible  so 
a  longer  time  is  better. 

B.  SHOOT 

The  friendly  forces  aust  effectively  and  efficiently 
eaploy  their  weapons  to  gain  the  aaziaua  benefit  of  their 
firepower.  Direct  and  indirect  fire  aust  be  organized  and 
placed  in  such  a  Banner  as  to  suppress  the  eneay 
capabilities  of  fire  and  detection.  ieapons  must  be  used  to 
conceal  and  protect  friendly  aoveaent  as  well  as  to  destroy 
the  eneay  force.  To  accoaplish  its  aission,  the  friendly 
force  aust  "destroy  enough  of  the  eneay  to  convince  hie  to 
break  off  his  attack,  to  give  up  a  defensive  area,  or  to 
move  froa  an  area  vital  to  friendly  forces."  [Ref.  16:pg. 

ii] 

"The  tank  with  its  cross-country  aobility,  its  araor 

?rot action,  and  its  foraidable  firepower,  has  been  and  is 
ikely  to  reaain  the  aost  iaportant  weapon  in  the 
battalion  task  force.  The  accuracy  of  tank  guns  gives 
then  a  high  probability  of  a  first  round  hit  and  the 
lethality  is  such  that  if  the  target  is  hit  it  will  be 
killed."  [Ref.  16:pg.  1-2] 

The  tank  and  other  aodern  weapons  require  trained  operators 
to  realize  the  full  potential  of  this  firepower.  If  aiaing 


70 


and  firing  are  not  done  correctly  large  amounts  of 
ammunition  will  be  expended  with  only  a  minimal  nuaber  of 
eneay  casualties  resulting.  If  gunners  incorrectly  identify 
targets  or  use  poor  target  selection  procedures  the  friendly 
force  could  sustain  aore  casualties  than  necessary  while  the 
eneay  continues  to  fight.  An  iaportant  point  to  reaeaber  is 
that  eneay  and  friendly  weapons  possess  similar  capabilities 
so  a  aajor  contributor  to  mission  success  or  failure  will  be 
how  well  each  side  uses  its  firepower  potential. 

To  assess  the  use  of  firepower  potential  the  performance 
of  the  weapons  systems  must  be  examined.  Each  weapon  system 
has  its  own  individual  impact  on  battle  outcome.  Along  with 
-his  iapact  is  a  synergistic  effect  gained  from  the  mutual 
support  of  other  weapons.  The  selected  BOEs  for  aission 
accomplishment  measure  this  combined  force  effect  and 
reflect  the  overall  force  effectiveness.  This  category  of 
NOEs  is  concerned  with  assessing  the  performance  of  selected 
weapons  systems:  tank  aain  gun,  TOH,  and  Dragon.  The 
perforaance  of  each  system  will  be  displayed  separately  in 
the  TRP,  but  will  be  measured  using  the  same  BOEs. 

Key  areas  in  assessing  weapon  perforaance  are  the 
accuracy  and  lethality  of  the  weapon,  its  contribution 
toward  aission  accomplishment,  and  the  amount  of  ammunition 
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expended  by  the  systea.  The  latter  factor  impacts  heavily 
on  the  required  logistic  support.  Proper  tactical 
eaployaent  of  all  syteas  aust  be  considered,  but  note  that 
this  overlaps  with  the  categories  of  aission  accomplishment 
and  aoveaent.  Shoot  MOEs  are  defined  to  address  these 
issues  as  an  input  to  perforaance  assessment. 

1 .  Huib.gi-2l-,.RQafl.4^..£iiad.,  IBBZL 

The  total  nuaber  of  rounds  fired  by  all  weapons  of 
this  type. 

HRF  =»  ^  (all  rounds  fired  by  this  weapon  type) 

This  aeasure  reflects  the  fire  capability  of  the  particular 

weapon  systea.  It  is  also  used  to  assess  anno  conservation 

and  accuracy.  This  is  not  a  stand  alone  aeasure  and  aust  be 
« 

considered  along  with  the  eneay  casualties  inflicted.  This 
nuaber  does,  however,  provide  an  indicator  for  logistical 
reguireaents  and  when  coabined  with  the  nuaber  of  casualties 
reflects  weapons  proficiency.  A  saall  number  in  this  HOE  is 
good,  provided  the  aission  is  successfully  accoaplished. 

2.  sftgaai&iaa .Ess-agasA-iSfi sl 

A  ratio  of  the  nuaber  of  eneay  tank  and  antitank 
weapons  killed  by  this  weapon  type  to  the  total  number  of 
rounds  fired  by  this  weapon. 
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*  of  eneay  tank  and  antitank  weapons  killed 
by  this  weapon  type 

CPB  * - - - - - — - 

#  of  rounds  fired  by  this  weapon  type 

"This  aeasure  addresses  kill  productivity  of  a  weapons 

systea  directly. "  (fief.  21: pg.  4-142]  It  considers  both  the 

accuracy  of  a  weapon  and  its  lethality. 


The  percentage  of  the  total  nuaber  of  rounds  fired 

that  hit  a  tank  or  antitank  weapon  system. 

total  #  of  hits  on  a  tank  or  antitank 
weapon  systea  by  this  weapon  type 

PBHT  * - - - - - i - -- - - X  100 

*  of  rounds  fired  by  this  weapon  type 

"This  is  a  direct  aeasure  of  accuracy  of  fire."  [fief. 

21: pg.  4-159]  There  are  soae  iteas  that  should  be  considered 

when  using  this  BOB  for  an  assessaent.  When  accuracy  of 

fire  appears  to  be  poor  the  range  between  the  firer  and  the 

target  aust  be  exaained.  A  pro blew  of  atteapting  to  use  a 

weapon  past  its  aaxiaua  effective  range  is  soaewhat 

different  froa  aissing  targets  that  are  within  range.  This 

HOE  does  not  distinguish  between  these  two  points.  Also, 

the  BTC  instruaentation  currently  uses  hits  and  kills  as  two 

distinct  and  autually  exclusive  groups  of  weapon  effect.  To 

derive  the  nuaerator  of  this  NOE  reguires  that  these  two 

groups  be  sunned. 
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4.  e?.£sgat_£gaafl§. 


The  percentage  of  the  total  nuaber  of  rounds  fired 


that  were  close  enough  to  the  target  to  iapart  a  suppressive 


effect  (and  be  reflected  by  the  MILES  instruaentation) ,  but 


did  not  actually  hit  the  target. 

#  rounds  counted  as  near  aiss  against  tank 
and  antitank  weapons  by  this  systea 

PRNH  * - - - X  100 

#  rounds  fired  at  tank/antitank  by 
this  weapon  systea 


"Hear  Bisses  are  thought  of  as  a  suppressive  effect.  They 
night  al?o  be  thought  of  as  a  secondary  guage  of  accuracy 
of  fire  in  the  sense  that  a  systea  with  a  high  percentage 
of  ngar  misses  is  aore  accurate  than  one  with  acre 
outright  Bisses,  when  percent  hits  is  equal."  [Bef. 

21 :pg.  4-160] 


This  neasure  is  not  used  alone,  but  should  be  used  with  the 


other  MOEs  as  an  input  to  total  firepower  effectiveness. 


s .  isaegaa-gcagUpnal.  Sill -fit fssUsgims  aim 


The  percentage  of  the  total  eneay  casualties  that 


was  inflicted  by  this  particular  weapon  systea. 


total  value  of  eneay  casualties  inflicted 
by  this  weapon  type 

WFKE  * - - - - - - - X  100 

total  value  of  eneay  casualties  inflicted 


The  value  of  each  eneay  player  is  available  in  the  BEI/HOV 


table  (Appendix  G)  stored  in  the  CIS.  This  aeasure  reflects 


the  relative  effectiveness  of  the  aajor  weapon  systeas  in 


the  force.  It  portrays  how  such  each  weapon  systea 


contributed  to  the  total  casualties  suffered  by  the  eneay. 
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0hen  coabined  with  the  other  HOEs  it  allows  for  assessaent 
of  tactical  weapons  eaployaent  and  firepower  effectiveness 
of  each  weapon  systea. 

C.  HOVE 

On  a  modern  battlefield  of  highly  lethal  weapons  the 
friendly  force  anst  be  proficient  in  aaneuver  in  order  to 
survive.  The  eneay  can  detect  aoveaent  that  is  not  Basked 
by  terrain  or  deception.  A  friendly  force  aust  conduct  a 
thorough  nap  study  and  ground  reconnaissance  when  possible 
before  selecting  routes.  The  OPFOB  is  extrenely  mobile,  and 
is  capable  of  moving  guickly  to  block  friendly  advances  or 
to  attack  through  gaps  that  night  occur  between  friendly 
forces. 

To  be  successful,  the  friendly  force  must  be  capable  of 
moving  guickly  to  engage  a  retreating  eneay  before  he  can 
reorganize.  If  a  gap  exists,  units  aust  aaneuver  promptly 
to  prevent  an  eneay  penetration.  The  keys  to  success 
include  using  the  terrain  properly  and  the  capability  to 
move  forces  guickly  to  decisive  places  in  the  battle  area. 

Neasures  in  this  area  of  perforaance  should  reflect  the 
ability  of  units  to  aeet  the  above  reguireaents.  A  leader 
who  uses  sound  tactical  principles  will  select  routes  that 
provide  protection  for  his  forces  and  allow  sufficient 


maneuver  area  to  use  his  nobility  potential.  1  well  trained 
unit  will  generally  tore  eore  rapidly  than  a  poorly  trained 
unit  because  subordinate  eleaents  will  require  less  direct 
control  and  supervision,  ihen  vehicles  are  properly 
aaintained  they  operate  longer  before  breaking  down,  thus 
providing  nore  aobility  potential  to  the  force. 

The  ability  to  aove  efficiently  and  effectively  is  of 
vital  importance.  Fast  aoveaent  rates  do  not  necessarily 
reflect  better  performance.  &  rapidly  moving  force  night 
sustain  a  high  level  of  casualties  because  it  is  moving  too 
fast  to  use  available  terrain  for  protection.  The  point  to 
be  made  is  that  aoveaent  is  an  input  to  overall  unit 
performance,  but  must  be  considered  in  the  light  of  other 
factors  (such  as  number  of  casualties)  ,  to  provide  a  measure 
of  unit  effectiveness. 

i  •  assa  J8&&& 

The  computation  of  distance  travelled  per  designated 
tine  period. 

total  distance  travelled 

HHT  - - 

total  elapsed  time  for  travel 

ka  the  elapsed  time  increases,  i.e.  for  an  entire  exercise 
segment,  this  measure  is  very  useful.  This  SOB  will  reflect 
the  travelling  speed  for  the  unit  which  averages  the 
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changing  rates  that  occur  throughout  the  tine  period.  In  an 
attack  aission  this  HOE  is  iaportant  since  coaaanders  need 
to  know  how  quickly  their  units  can  be  expected  to  move  to 
an  objective.  For  a  defense  aission  this  HOE  is  not 
aeaningful.  However,  in  a  delay  this  aeasure  could  be  used 
to  account  for  the  eneay  aean  rate  of  travel;  in  this  case  a 
smaller  nuaber  would  be  better  than  a  large  nuaber.  This 
HOE  is  a  direct  aeasure  of  movement  performance.  "It  is 
considered  superior  to  siaple  amount  of  advance  which  does 
not  take  into  account  a  possible  increase  in  difficulty  of 
advance  as  distance  from  eneay  decreases."  [Bef.  21:pg. 
4-15] 

2.  Atoflga 

This  is  the  rate  at  which  a  unit  advances  toward  a 
designated  location  (objective)  . 

distance  froa  start  point  to  objective 

BATO  *  - 

elapsed  tiae  to  travel  froa  start 
point  to  objective 

This  aeasure  addresses  the  tiaeliness  aspect  of 
maneuverability .  It  is  different  froa  movement  rate  in  than 
the  only  distance  considered  in  the  computation  is  that 
portion  of  aoveaent  that  gets  the  force  nearer  the 
objective.  A  long,  circuitous  route  sight  allow  for  a 
faster  aean  rate  of  travel  than  a  more  direct  avenue  of 
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approach,  bat  there  will  be  a  longer  total  distance  to  lore. 
&  direct  route  is  shorter,  bat  allow  only  a  slow  rate  of 
travel.  This  aeasure  combines  both  route  selection  and 
speed  into  a  single  number.  The  distance  froa  the  start 
point  to  the  objective  is  fixed  so  the  actual  route 
travelled  does  not  change  the  nuaerator,  but  the  travel  tiae 
froa  start  to  end  will  vary  depending  on  the  length  of  the 
route  and  how  rapidly  a  force  can  aove  along  the  selected 
route.  This  HOE  can  be  used  to  assess  tactical  aoveaent 
plans  and  the  aaneuver  capability  of  the  force. 

Since  each  coapany  size  eleaent  is  a  separate 
entity,  usually  with  its  own  objective,  this  HOE  will  be 
coaputed  for  each  aaneuver  coapany.  This  aeasure  is 
aeaningful  for  the  friendly  force  when  the  aission  includes 
aoveaent,  such  as  attack.  In  this  case  a  larger  nuaber  is 
better.  When  a  friendly  force  has  a  aission  to  defend  or 
delay  its  aoveaent  rate  will  be  less  aeaningful.  In  this 
case  the  HOE  should  aeasure  the  eneay's  rate  of  advance 
toward  the  friendly  position.  Again,  a  separate  aeasure  for 
each  coapany  would  be  appropriate.  &  saaller  nuaber 
represents  better  perforaance  in  this  case  since  the 
friendly  force  is  atteapting  to  iapede  the  eneay  advance. 
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This  is  the  peccant  of  the  friendly  force  that  is 
engaged  with  the  enemy,  averaged  over  the  duration  of  the 
exercise. 


#  of  friendly  platoons  engaged 
each  period 

total  *  of  friendly  platoons 

APFC  * - - - X  100 

total  #  of  periods  where  engagement  occurs 

A  platoon  is  considered  engaged  for  an  update  period  (every 

five  minutes)  when  a  weapons  pairing  event  occurs  for  at 

least  one  member  of  the  platoon.  Begardless  of  the  number 

of  pairings  each  platoon  will  be  counted  as  engaged  only 

once  during  each  period.  A  unit  that  goes  through  a  series 

of  periods  with  no  enemy  contact  will  not  necessarily 

receive  a  lower  number  than  a  unit  constantly  engaged 

because  only  the  periods  where  an  engagement  occurs  are 

counted  in  the  denominator. 

This  HOE  provides  a  relative  display  of  how  well  a 
commander  maneuvered  and  positioned  his  force  in  order  to 
direct  maximum  firepower  at  the  enemy  force,  tfhere  the 
mission  is  to  avoid  decisive  contact,  such  as  delay,  a 
smaller  number  for  this  measure  would  be  better  provided  the 
friendly  force  delayed  the  enemy  movement  as  directed  by  his 
mission.  This  measure  provides  a  hey  input  for  assessing 


79 


overall  deployment  and  maneuver  of  forces  when  coupled  with 
the  flOSs  for  mission  accomplishment. 

4.  Qperational-&g&aiaes&_iQgl 

This  is  the  percentage  of  friendly  combat  vehicles 
that  successfully  participated  in  the  exercise  without  a 
disabling  maintenance  failure,  k  disabling  maintenance 
failure  shall  be  defined  as  any  failure  which  renders  the 
vehicle  reportable  on  the  D k  fora  2406  (Materiel  Readiness 
or  Deadline  Report) . 

(#  vehicles  begin  exercise)  - 
(*  vehicles  lost  for  maintenance) 

or  * - 

*  vehicles  begin  exercise 

The  "downtime"  or  time  taken  to  repair  the  vehicle  is  not  a 
factor  here,  but  rather  only  the  occurrence  of  such  a 
failure  in  the  vehicle,  k  unit  must  conduct  routine  and 
proper  maintenance  on  its  equipment  if  the  items  are 
expected  to  continue  operating,  iithout  vehicles  a  friendly 
force  loses  effectiveness  in  mobility  and  firepower.  When  a 
vehicle  experiences  maintenance  failure  it  not  only 
decreases  the  unit  combat  potential,  but  also  becomes  a 
burden  for  the  logistics  and  support  elements. 

The  number  generated  by  this  BOB  is  a  direct 
assessment  of  the  unit's  vehicle  maintenance  capability. 


Vehicles  lost  to  enemy  fire  are  not  considered  to  be  a 


aainfanance  failure  unless  the  failure  occurred  before 
receiving  eneay  fire.  Mo  individual  vehicle  aay  be  counted 
aore  than  once  during  a  segaent  for  this  HOE.  This  is  to 
preclude  negative  OB  values,  which  would  be  aeaningless. 

D.  COMMUNICATE 

The  ability  to  coaaunicate  with  other  friendly  eleaents 
during  a  battle  cannot  be  overeaphasized.  Effective  coaaand 
and  control  are  not  possible  if  the  leaders  are  unable  to 
coaaunicate  with  their  units.  Coaaanders  need  the  ability 
to  direct  friendly  aaneuver  and  soaetia es  change  designated 
plans.  To  facilitate  guich  reaction  a  unit  aust  receive 
orders  in  a  finely  aanner.  When  eneay  contact  occurs  a 
leader  is  aided  by  indirect  fire  weapons  if  he  can  call  an 
artillery  or  aortar  unit.  Coordination  with  adjacent  and 
supporting  eleaents  is  necessary  to  insure  efficient 
eaployaent  of  assets  and  to  avoid  interfering  with  other 
friendly  operations.  Without  effective  conn  unications  a 
battle  could  be  total  chaos. 

As  a  point  of  assessnent,  well  planned  operations 
usually  provide  contingencies  for  possible  events,  thus 
requiring  fewer  changes  to  orders.  Units  that  are  properly 
trained  can  react  to  a  developing  situation  without  close 
direction  and  supervision  froa  seniors.  A  coaaander 
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preplans  fires  to  support  bis  operation,  thus  requiring  less 
tiae  to  sake  a  call  for  fire  when  needed.  When  units  have 
trained  together  and  are  aore  proficient  in  tactical 
operations  the  aaount  of  coordination  effort  is  reduced. 
Coaaunication  procedures  emphasize  that  messenger  or  wire 
linked  telephone  is  better  than  the  radio  whenever  possible 
to  preclude  interception  or  jamming  by  the  enemy,  ihen 
radios  are  used  the  operators  should  be  trained  to  avoid 
coaaunication  security  (COHSEC)  violations,  i.e.  excessive 
transmission  tines,  transmitting  compromising  inforaation 
about  friendly  forces,  etc.  Good  comaanders  will  use  their 
available  tiae  wisely  for  planning  and  will  allow  sufficient 
tiae  for  subordinates  to  conduct  their  planning.  The 
dissemination  of  orders  and  combat  intelligence  is  important 
to  insure  that  all  friendly  forces  have  the  maximum  amount 
of  inforaation  possible  to  help  in  planning  and/or  executing 
assigned  missions.  These  areas  should  be  considered  when 
assessing  a  unit's  communication  capability. 

All  MOEs  in  this  category  have  been  defined  so  that  a 
smaller  number  represents  better  performance.  Each  HOE  is 
aimed  at  providing  an  assessment  of  the  unit  performance  for 
the  considerations  discussed  above.  The  collective  set  of 
MOEs  will  reflect  the  unit's  overall  communication 
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capability.  Any  specific  HOE  with  a  high  amber  in  this 
area  could  be  an  indicator  for  identifying  training 
deficiencies. 

1 .  Average  Transaission  Duration  LkISL 

The  average  duration  of  a  radio  transaission  aade  by 
tha  friendly  force. 

total  suaaed  duration  of  all  friendly 
radio  transaissions 

ATD  - - - - 

*  of  friendly  radio  transaissions 

This  measure  provides  an  indicator  of  how  long  each  radio 

transaission  lasted.  For  well  trained  units  all 

coaaunications  should  be  brief,  with  the  unit  relying 

instead  on  standard  operating  procedures  (SOPs).  Lengthy 

information  should  be  sent  by  soae  aeans  other  than  radio. 

The  longer  a  radio  set  remains  keyed,  the  greater  the  chance 

that  the  enemy  will  intercept  the  signal.  Coaaunications  of 

short  duration  serve  to  deny  the  aneay  information  about  the 

friendly  force  and  increase  the  chance  of  survival. 


2. 


-Skill 


This  is  the  average  number  of  radio  transaissions 
per  time  period  aade  by  the  friendly  force  during  the 
exercise. 


ANT 


*  of  friendly  radio  transaissions 
elapsed  tiae  of  the  exercise  (min  or  hr) 
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As  discussed  above,  a  unit  should  attempt  to  ainiaize  its 
use  of  the  radio.  An  excessive  nuaber  of  transaissions 
allows  the  eneay  to  track  friendly  aoveaent  based  on  eaitted 
radio  signals.  The  aore  often  a  radio  is  used  the  aore 
chances  the  eneay  has  for  exactly  locating  the  unit.  The 
opportunity  to  coaait  COBSEC  violations  increases.  A  large 
nuaber  for  this  BOE  reflects  extensive  supervision  or 
direction  between  eleaents  which  should  not  be  necessary  for 
well  trained  units.  Dividing  by  the  elapsed  tiae  of  the 
exercise  serves  to  "normalize"  the  nuaber  for  coaparison 
with  exercises  of  different  duration. 

3.  Percent  of  Transaissions  Possible  BPF  1BPF) 

The  percentage  of  friendly  radio  transaissions  that 
exceeded  25  seconds,  but  were  less  than  55  seconds  in 
duration. 

*  of  transaissions  >25  seconds  and  <55  seconds 

RDF  - - 

#  of  friendly  radio  transaissions 

A  radio  transmission  period  of  25  to  55  seconds  is 

sufficient  tiae  for  the  eneay  to  "radio  direction  find" 

(RDF)  a  unit  location  [Ref.  22:  pg.  57],  This  means  that  the 

eneay  can  establish  a  close  approximation  for  the  friendly 

unit  location  if  a  radio  transmits  for  that  duration.  If  a 

unit  continually  transmits  for  this  lengthy  duration  it  will 
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be  located  and  the  aost  likely  result  is  that  eneay  fire 
will  be  directed  on  the  position.  To  increase  the  unit 
survivability  and  deny  the  eneay  inforaation  about  friendly 
locations  this  nuaber  should  be  low. 


4. 


The  total  nuaber  of  radio  transaissions  of  duration 
greater  than  or  equal  to  55  seconds. 


WST  *  I  of  radio  transaissions  >  55  seconds 


The  eneay  has  the  ability  to  pinpoint  a  friendly  location  if 
a  radio  transaission  froa  that  location  lasts  55  seconds  or 
more  [Ref.  22: pg.  57].  To  provide  aaxiaua  protection  for 
the  unit  the  nuaber  of  transaissions  in  this  category  should 
be  ainiaized. 


The  "percentage  of  total  planning  tiae  available 


that  an  echelon  allows  to  all  lower  echelons."  Here,  the 


percent  aaount  of  tiae  that  the  battalion  task  force  allows 


to  its  coapanies. 


tiae  Co  ordered  to  start  execution  - 
tiae  TF  order  issued 

PPTF  - - X  100 

tiae  Cp  ordered  to  sta^t  execution  - 
tiae  aission  received  by  T F 


This  aeasura  accounts  for  the  tiaeliness  of  the  coaaand 


function.  It  considers  planning  tiae,  decision  tiae,  tiae 
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to  prepare  an  order  and  then  disseainate  it  to  subordinate 
elements.  "The  aeasure  addresses  effectiveness  of  coaaand 
and  control  by  assessing  how  quickly  planning  is  coapleted 
on  an  order  issued  in  relation  to  the  tiae  available."  [fief. 
21:pg.  4-120]  This  HOE  not  only  addresses  the  effectiveness 
of  the  coaaand  functions,  but  also  assesses  the 
coaaunication  procedure  in  the  coordination  phase  of  the 
planning  and  in  the  actual  disseaination  of  the  order.  & 
rule  of  thuab  states  that  each  echelon  should  allow  501  of 
the  available  tiae  for  its  subordinate  units  in  the  order 
preparation  activities.  This  aeasure  does  not  assess  the 
quality  of  the  planning  or  the  order  that  was  issued.  [Ref. 
21:pg.  4-120]  The  input  inforaation  for  this  HOE  aust  be 
obtained  annually  by  the  observer/controllers  (OC*s)  . 


The  tiae  required  to  disseainate  an  order, 
directive,  or  warning  to  all  eleaents  at  the  next  lower 
echelon  of  coaaand. 

(tiae  Bn  TF  order  acknowledged  by  last  Co)  - 
(tiae  order  was  approved) 

8DT  - - 

#  of  orders  issued 

If  coapanies  are  to  conduct  proper  planning  and  preparation 
for  operations  they  need  inforaation  on  a  tiaely  basis. 
Units  that  are  well  trained  usually  have  BOPs  for  preparing 
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and  distributing  orders  to  subordinate  elements.  These 
aethods  decrease  disseaination  time,  increase  the 
reliability  of  aessage  receipt  and  usually  avoid  radio 
transaission  since  the  duration  would  be  lengthy.  This 
aeasure  assesses  the  effectiveness  of  the  coaaunication  link 
that  ties  the  coapanies  to  the  battalion  headquarters.  A 
saaller  nuaber  is  better  for  this  NOE  [Bef.  21: pg.  4-122]. 
The  input  inforaation  for  this  HOE  aust  again  be  obtained 
froa  the  OC.  It  aay  also  be  possible  to  obtain  this 
inforaation  froa  the  aonitored  battalion  coaaand  net,  if 
orders  are  habitually  sent  and  acknowledged  by  radio. 


it.  TBB.imgiBs.g£&Bta&aa-££amg 

kray  training  evaluations  have  never  before  provided 
statistically  reliable  data  (see  Chapter  1,  section  C) .  One 
of  the  eajor  weaknesses  of  the  kHTEP  systes  has  been  the 
lack  of  consistent,  reliable  evaluations.  This  has  proaoted 
the  vicious  cycle  of  sister  battalions  evaluating  each  other 
in  training,  and  therefore  causing  all  such  evaluations  to 
sink  to  the  "lowest  coaaon  denoainator".  One  unit  cannot 
evaluate  another  beyond  its  own  skill  level.  The  BTC 
provides  the  kray  with  the  first  real  opportunity  to 
establish  a  consistent  kray-wide  training  evaluation  that 
reflects  true  unit  perforaance.  This  opportunity  will  be 
lost  if  no  standards,  noraative  or  absolute,  are  applied  in 
the  evaluation.  At  this  point  in  tine  it  is  very  difficult 
to  generate  absolute,  fixed  nuabers  to  be  used  as  standards 
for  the  various  BOEs  defined  previously.*  Without  such  fixed 
standards  there  is  no  current  aethod  available  to  convey  the 
existence  of  a  standard  or  level  of  perforaance  to  a  unit, 
k  noraative  evaluation,  however,  provides  a  aeans  for 
solving  this  problea. 

•Indeed,  due  to  the  synergistic  effects  of  coabat,  it 
may  be  iapossible  to  set  nuaerical  standards  for  soae  of  the 
BOEs  generated  in  the  top-down  analysis. 
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The  purpose  of  the  TBP  is  to  provide  an  objective 
training  evaluation  to  the  heavy  battalion  task  force 
commander  in  order  to  best  facilitate  remedial  training  in 
the  eost  efficient  Banner.  In  the  previous  discussion  of 
the  POT  cycle  it  was  pointed  out  that  the  key  to  training 
was  the  establishaent  and  evaluation  of  training  standards. 
The  TRP  system  is  designed  to  accomplish  the  evaluation  of 
training  standards  for  large  units.  It  does  this  without 
setting  an  arbitrary  quantitative  standard  by  utilizing  a 
normative  (relative  performance)  based  evaluation.  This 
goal  is  consistent  with  the  ABTEP  philosophy  of  training, 
the  purpose  of  the  BTC,  and  the  BTC  development  plan  as 
written  by  HQ,  TBADOC.  [Refs.  6,13,14] 

The  TBP  is  based  upon  quantified  measures  specifically 
designed  (as  previously  shown)  to  eliminate  human  bias  and 
error  in  evaluation.  Its  use  will  make  substantial  progress 
in  eliminating  subjectivity  in  performance  evaluation.  The 
format,  it  is  felt,  is  concise,  brief,  and  easy  to 
understand.  It  employs  as  a  methodology  the  simple  concept 
of  normal  scores  which  is  readily  familiar  to  the  Army 
Officer  Corps.  All  data  is  presented  in  a  format  which  has 
many  intrinsic  benefits,  is  simple  to  calculate  using 
existing  equipment,  and  utilizes  an  off-the-shelf 
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methodology  which  has  been  proven  to  be  reliable  as  an 
indicator  of  perforsance. 

In  order  to  effectively  implement  the  THP  concept  soee 
minor  changes  will  be  required  in  the  statistical  aethods  of 
the  MTC.  Such  changes  involve  only  snail  recalculations  of 
new  statistics  utilizing  the  nuabers  currently  provided  by 
the  NTC  data  gathering  structure.  Some  additional  OC  inputs 
are  necessary,  but  these  are  not  burdensoae  and  indeed, 
border  on  the  trivial.  No  new  instrunented  measurements  are 


required  for  the  THP.  The  aethodology  has  been  created  to 
function  within  the  existing  NTC  operational  framework. 

let  for  the  effort  of  recalculating  sone  statistics, 
certain  very  tangible  benefits  will  be  realized  .  The  THP 
will  provida  the  following  enhanceaents  to  the  KTC 


evaluation  structure: 


csUssUqb  2i  aissip  afisaiEiisifsai --The  tbp 
utilizes  several  accepted  Army  Hoes  [Her*  21]  that  will 
give  a  clearer  picture  of  actual  unit  aission 
accoaplishaent.  The  coaaonly  accepted  technique  of 
"normalizing"  data  [Eef.  19:pp.  39-40  ]  permits  a  more 
introspective  assessaent  of  overall  unit  performance. 

Bqttqi;  understanding  of  Eilatjyg  performance  ([without 
comparison) — using  the  TsP7~ a  commander  and  his  staff  can 
gain  a  truer  picture  of  their  organization '  s  relative 
level  of  training.  The  use  of  a  percentile  evaluation 

mdi  a  d onraa  of  rolafi»o  Dprfnnanea  yhi  rh  dan 


_  _ _ _  _  _ _ these 

benefits  to  be  gained,  no  unit  comparison  or  "scoreboard" 
is  necessary;  indeed,  the  aethodology  almost  entirely 
precludes  grading  and  stays  within  the  &BTEP  philosophy. 


Ittlougf^hf^ffc^evefopme&Hlan 


7  to 
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Ill-Ill  requires  unit  performance  to  be  coapared  to  a  set 
of  standards,  the  TBP  methodology  aandates  no  fixed 
standards.  Since  the  coaaander  is  doctrinally  responsible 
fop  fixing  standards  f'Bef.  5:  pg.13],  the  TBP  evaluates 
units  based  on  relative  coapetence  only  and  allows  the 
coaaander  to  fix  standards  at  whatever  level  desired.  The 
TBP  also  readily  lends  itself  to  the  calculation  of 
standards  when  it  is  deeaed  appropriate  to  do  so. 


coapleaentarv  weaknesses  (cause  and 
Ijl  proyiae  4  fore  distinct  auait  trail 


are  often  unintelligible  when  presented  in  the  fora  of 
bare  nuabers  and  statistics.  The  foraat  of  percentile 
evaluation  allows  for  greater  depth  of  analysis. 


The  TBP  is  a  aajor  aid  to  identifying  training 


weaknesses.  It  will  highlight  deficiencies  auch  sore 


efficiently,  it  is  felt,  than  siaple  numerical  summaries  of 


training  events.  It  will  facilitate  the  commander's  own 


appraisal  of  his  unit's  perforaance  and  help  to  focus  his 


subsequent  training  efforts.  This  action,  in  turn,  helps  to 


conserve  valuable  resources  and  achieve  the  desired 


goal--the  most  efficient,  effective  training  possible  under 
the  train-evaluate-train  concept,  both  at  the  BTC  and  the 
unit  home  station. 


A.  THE  DECILE  EVALUATION 

An  efficient  set  of  aeasures  of  effectiveness  have  been 
defined  that  reflect  coabat  training  proficiency.  It 
remains  to  be  shown  how  best  to  present  to  the  coaaander  the 
inforaation  contained  in  these  aeasures.  A  unit  can  conduct 
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Meaningful  remedial  training  only  after  it  clearly  j 

undt  stands  where  all  training  deficiencies  lie.  s 

it  first  consideration  it  would  sees  that  the  raw  score4 
obtained  froa  the  HOB  would  present  all  needed  infornation. 

* 

Indeed,  if  this  HOB  really  represents  a  quantitative  j 

$ 

l 

evaluation  of  unit  perforaance,  can  the  raw  nuaber  be 
iaproved  upon?  Certainly,  because  the  raw  score  only 

! 

reflects  things  as  they  happened  at  that  aoaent  in  tiae  when 

i 

I 

the  unit  conducted  its  operation.  Other  synergistic  effects 

f 

on  the  instruaented  battlefield  could  have  influenced  these  ! 

raw  scores  on  any  other  given  day.  This  is  to  say  that  ! 

there  is  soae  inherent  inaccuracy  in  every  evaluation,  no  ! 

matter  how  carefully  crafted. 

"In  the  aore  general  sense,  the  notion  of  the  equality  of 

raw  scope  units  clearly  violates  one's  sense  of  an  t 

underlying  scale  since  the  raw  score  scale  separations  are 

only  the  result  of  the  interaction  of  the  particular  itens 

that  have  been  put  in  the  test  and  therefore  have  no 

generality."  [Sef.  23;  pg.  511] 

Thus,  in  order  to  convey  real  generality  (and  hence  true 

perforaance)  these  raw  scores  aust  be  operated  on  and 

displayed  in  the  context  of  relative  (noraative)  i 

I 

t 

perforaance,  which  tends  to  account  for  with in-exercise 


variations.  Soae  aethodology  aust  demonstrate  what  the  raw  i 

t 

— — —  ——  —  —  —  —  ————  1 

•"Score"  as  used  here  refers  only  to  the  numbers 
obtained  from  the  HOEs  themselves  ana  is  consistent  with  ! 

current  evaluation  literature.  It  does  not  imply  a 

competitive  "test"  value,  and  should  not  be  construed  to  be  ! 

one.  i 
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score  of  each  NOE  aeans  when  related  to  the  population  of 
heavy  battalions  in  the  Aray  that  have  trained  at  the  MTC. 
In  this  Banner  a  truer  unit  evaluation  can  be  obtained — one 
which  reflects  relative  training  accoaplishaent,  both  Aray- 
wide  and  between  aeasured  areas,  or  NOEs. 


Essentially,  the  procedure  being  suggested  for  the 


TRP  is  that  aggregated  totals  of  unit  perforaance  statistics 


will  provide  a  defacto  set  of  standards  against  which 


another  unit  can  be  coapared.  This  is  not  aeant  to  iaply 


"unit  coaparison",  but  rather  that  aggregated  statistics 


over  the  long  haul  will  provide  an  adequate  set  of  standards 


or  precisely,  noras.  This  is,  in  fact,  the  procedure  as 


envisioned  for  the  MTC  by  HQ,  TRADOC: 


"A  secondary  objective  (of  the  phase!  will  be  to  define 
baseline  (nora  based)  standards  by  trend  analyses  of  the 
data  base.  Qualitative  standards  developaent  will  be  a 
continuing  process  until  criterion  based  coabat  standards 
for  the  NTC  scenarios  are  developed.  This  phase  will  be 
continuous.  Initial  standards  will  be  developed  by  Aug 
80."  14: pg.  III-10] 


There  are  several  assuaptions  implicit  within  this  method. 


a.  Normative  Perforaance 


The  first  and  key  assumption  made  is  that  unit 
perforaance,  on  the  whole,  will  reflect  an  adeguate  level  of 
aission  accoaplishaent.  Certainly,  in  the  abscence  of 
nuaerical  standards,  it  aakes  no  sense  to  coapare  a  unit 
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against  a  set  of  norms  if  the  normative  perforaance  (as 
reflected  in  the  data  base)  is  inadeguate.  If,  in  the  data 
base,  aost  units  are  failing  to  accoaplish  a  particular 
aission,  it  would  be  useless  to  coapare  another  unit  against 
this  aggregate.  Such  a  data  base  only  provides  the  nora  for 
failure. 

Therefore,  the  assuaption  is  nade  that  aost 
units  training  at  the  KTC  will  accoaplish  their  aission. 

This  assuaption  would  seea  to  be  borne  out  by  the  fact  that 
historically,  in  training,  units  rarely  fail  utterly  in 
accoaplishing  their  aission.  Naturally,  degrees  of  aission 
accoaplishaent  exist.  It  is,  however,  believed  that  this 
topic  will  not  prove  to  be  5  serious  problea  in  practice. 

The  second  assuaption  regarding  noraative 
perforaance  is  that  aggregated  unit  performance  will  provide 
an  acceptable  noraative  standard.  As  an  example,  it  is 
assumed  that  heavy  battalion  task  forces  training  at  the  NTC 
will  not  regularly  be  annihilated  in  the  hasty  attack,  or 
any  other  aission.  Certainly  if  training  battalions 
regularly  suffer  85%  casualties  in  order  to  accoaplish  a 
given  aission,  this  would  provide  an  unacceptable,  although 
adeguate,  standard  (i.e.  the  aission  is  being  accomplished, 
but  at  too  high  a  cost).  This  situation  is  aore  likely  to 
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occur  than  the  former.  If  this  assuaption  proves  to  be 
false  it  can  be  corrected  by  "fine  tuaing,,  exercises  and 
scenario  redesign.  On  the  real  battlefield  coaaanders  will 
not  regularly  assign  iapossible  aissions  to  units  which 
require  virtual  unit  destruction  in  order  to  achieve  mission 
success.  Therefore,  it  is  assuaed  that  units  will  be  able 
to  accoaplish  most  assigned  aissions  (if  properly  executed) 
without  sustaining  excessive  casualties, 
b.  NTC  Procedures 

In  calculating  portions  of  the  TEP  it  is  assuaed 
that  standard  scenarios  of  roughly  equal  difficulty  are 
being  employed.  Currently,  it  is  planned  to  draw  from  a 
series  of  pre-packaged  scenarios,  constructed  by  mission 
(see  Appendix  A)  ,  the  particular  situation  to  serve  as  the 
basis  for  issuing  exercise  segment  operations  orders 
(OPORD) .  These  scenarios  have  been  developed  b'  sed  on  the 
guidance  of  the  NTC  commander  [Bef.  24]  and  are  designed  to 
be  of  relatively  equal  difficulty  for  each  mission. 10 
Several  versions  of  each  scenario  exist.  These  versions  are 
designed  to  play  the  saae  scenario  (mission)  over  different 
terrain.  The  assumption  of  equal  difficulty  is  inherently 

*°Based  on  discussions  in  September  of  1981  with  MAJ  Jia 
Ireland.  tJTD-NTC  CATE ADA,  the  action  officer  responsible  for 
developing  the  scenario  package. 
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tough  to  validate.  However,  it  is  not  deeaed  likely  to  be  a 
problem,  as  coaaon  ailitary  Judgement  seeas  capable  of 
producing  scenarios  of  egual  difficulty. 

It  is  also  assumed  that  the  IBP  calculations 
will  be  restricted  to  scenarios  of  like  intensity.  Unit 
coaaanders  aay  choose  the  exercise  intensity  level  they 
desire  for  their  units.  These  intensity  levels  are 
deterained  by  fixed  quantitative  inputs  expressed  in  teras 
of  OPFOB  coabat  assets.  Thus,  for  exaaple,  a  hasty  attack 
scenario  at  intensity  level  3  requires  certain  actions  and 
the  presence  of  certain  specific  OPFOB  assets,  is  this 
intensity  level  is  quantifiable,  it  is  assuaed  that  TBP 
calculations  will  be  restricted  to  like  intensity  levels  and 
thereby  the  TBP  calculations  will  be  drawing  samples  from  a 
hoaogeneous  population. 

Lastly,  it  is  assuaed  that  data  which  is 
contaainated  by  machine  failure  in  any  significant  way  will 
not  be  incorporated  into  the  TBP  statistics. 

&  quick  perusal  of  the  HOEs  selected  for  the  TBP 
makes  one  fact  obvious.  Although  each  HOE  produces  a 
quantitative  nuaber,  all  are  on  incoaaensurate  scales  or 
consist  of  different  aeasured  iteas.  Each  HOE  can,  in  fact. 
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be  considered  to  be  a  random  variable  possessing  its  own 
unique  distribution.  The  probles  of  cosparing  these  iteas 
in  order  to  deteraine  training  weaknesses  (and  subsequently 
allocating  training  resources  for  reaedial  training)  becoaes 
a  little  like  sorting  apples,  oranges  and  bananas  for  "the 
best  color".  Each  itea  (HOE)  has  its  own  intrinsic  scale  of 
aeasureaent.  Almost  every  HOE  collects  data  on  a  ratio 
scale,  i.e.  a  scale  that  possesses  a  fixed  zero  point  for 
calibration  (see  Appendix  0)  ,  but  each  scale  is  soaewhat 
different  in  terms  of  aeasureaent  units. 

Therefore,  in  order  to  evaluate  relative  performance 
across  varying  HOEs,  some  method  of  transforming  this 
quantitative  data  becomes  necessary.  Educational 
aeasureaent  literature  describes  several  scaling  methods. 
Each  has  its  own  usefulness,  but  in  particular,  the  T-score 
scale  is  selected  here  for  use  with  the  NTC  data. 

The  main  reason  for  choosing  a  scaling  method  lies 
in  the  principle  that: 

"In  no  case  does  a  single  aeasureaent  give  us  a  great  deal 
of  information.  A  single  aeasureaent  selected  from  a 
known  distribution  tells  us  much  more,  for  then  ve  can  say 
whether  the  item  picked  is  exceptionally  large  or  small. 

In  fact,  we  can  say  what  proportion  of  cases  fall  above  or 
below  it."  [Ref.  25:pg.  325 j 

Each  HOE  can,  of  course,  be  considered  to  be  a  random 

variable.  Thus,  one  of  the  easiest  methods  for  conducting 
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an  analysis  of  relative  perforaance  would  be  to  construct  a 

frequency  distribution  for  each  HOE,  and  then  coapare  the 

aeasured  unit  data  point  to  this  distribution  to  obtain  a 

straight  percentile  evaluation.  This  is  an  acceptable 

procedure  and  is  siaple  to  perfora.  However,  there  are 

disadvantages  to  this  nethod,  and  chief  aaong  then  is: 

"The  percentile  rank  scale  is  clearly  ordinal  and, 
according  to  aost  points  of  view,  its  units  are  unequal 
since  they  are  intended  to  provide  equal  proportions  of  a 
group,  not  equal  intervals  on  a  scale  of  ability."  [Bef. 
23:pg!  515]  1  1 

One  of  the  intrinsic  goals  of  the  TBP  is  to  reflect  the 

perforaance  of  a  unit  across  various  HOEs  on  a  scale  of 

ability,  that  is,  to  help  the  coaaander  determine  which 

areas  aost  need  further  attention.  Therefore,  arranging  HOEs 

on  a  scale  of  "equal  ability"  becoaes  iaportant. 

Additionally,  if  we  do  not  know  the  distribution  of  each 

HOE,  it  should  be  considered  that: 

"Hany  tines  it  is  difficult  to  look  at  an  entire 
distribution,  and  we  should  like  soae  way  of  designating  a 
single  score  (aeasureaent)  so  that  its  value  tells  at  a 
glance  whether  it  is  a  comparatively  large  or  snail 
value."  (Ref.  25:pg.  325] 

Therefore  if  we  wish  to  use  the  TBP  as  a  resource  and 
training  allocation  tool  we  should  obtain  evaluations 
reflecting  equal  intervals  on  a  scale  of  ability.  The 
measures  of  relative  perforaance  should  be  drawn  from  a 
known,  recognizable  distribution  with  a  predetermined  mean 
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and  standard  deviation  for  ease  of  HOE  comparison.  The  T- 
score  aethod  of  scaling  provides  these  characteristics. 

Finally,  once  the  MTC  is  in  fall  operation  it  aay  be 
discovered  that  the  instruaented  data  requires  MsaoothingM. 
That  is,  battlefield  synergisa  aay  cause  data  to  be  obtained 
in  a  n on-continuous  Banner,  k  histograa  of  such  data  for  a 
particular  NOE  aay  reveal  "bunches"  or  gaps  in  the 
distribution.  This  problea  can  be  overcone  by  enploying  T- 
scores.  The  T-score  aethod  can  elininate  such  synergistic 
effects  or  day-to-day  variation  by  "saoothing"  the  data.11 

The  T-score  is  a  normalizing  aethod.  Regardless  of 
the  NOE  distribution,  T-scores  are  reflected  against  a 
noraal  probability  distribution.  In  this  sense  it  is 
"distribution  free".  The  T-score  aethod  is  described  as 
follows  [Ref.  25:pg.  325-326].  k  baseline  data  set  is 
defined  against  which  the  current  evaluated  unit  is  to  be 
related.  Given  the  nuaerical  value  (say  H)  for  an  NOE,  the 
nunber  is  coapared  to  the  baseline  data  set  for  that  NOB. 

The  proportion  "p"  of  cases  falling  below  this  value  is 
deterained.  This  "p"  value  is  then  used  with  a  cuaulative 
noraal  distribution  table  to  obtain  a  "z"  value.  The  "z" 

11This  advantage  to  using  T-scores  does  carry  with  it  an 
underlying  assumption  that  the  data  being  "smoothed"  is,  in 
fact,  drawn  froa  a  noraal  distribution. 
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value  corresponds  to  the  point  on  the  normal  curve  abscissa 

where  the  area  under  the  curve  to  the  left  of  Mz"  equals  "p" 

percent  of  the  total  area  under  the  curve.  Row,  any 
variable  "T"  can  be  "standardized1*  by  a  linear 
transforaation  to  a  designated  scale  (This  is  the  coaaon 
aethoi  of  Z-scores,  (Ref.  25:pp.  31-32]).  The  scale  used  by 
the  T-score  (arbitrarily  chosen  here)  has  a  aean  equal  to  50 

and  a  standard  deviation  equal  to  10.  This  choice  will 

facilitate  later  coaparison  efforts  and  provides  the  "equal 
interval  of  ability"  in  the  fora  of  the  standard  deviation, 
which  equals  10.  The  standardized  value,  (T-50)  /10,  is  then 
set  9qual  to  the  "z"  value  obtained  above.  The  resulting 
equation. 


2  *  (T-50)  /10 

is  solved  for  T  which  is  the  desired  T-score.  [Ref.  25:pg. 
325-326] 

As  an  example,  if  H  is  such  that  90*  of  the  baseline  case 
measure?  fall  below  it,  then  p».90.  Consulting  a 
cumulative  noraal  distribution  table  yields  a  2*1.28  for 
this  corresponding  p  value.  This  leads  to  the  equation: 
1.28  *  (T-50)/10.  Solving  the  equation  produces  T  *  62.8. 

This  score,  then,  relates  unit  performance  on  this 

single  BOB  to  the  baseline  data  for  that  BOE.  It  provides  a 

"noraalized"  aeasure  that  reflects  actual  unit  perforaance. 

This  aeasure  will  facilitate  later  statistical  operations  on 

the  data,  but  for  the  aoaent  it  provides  a  representation  of 
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relative  unit  performance  on  an  equal  interval  scale  of 
ability. 


"It  was  pointed  out  earlier  that  since  the  properties  of 
the  raw  score  scale,  or  a  linear  transformation  of  the  raw 
score  scale,  are  dependent  on  the  characteristics 
fdiff realties  and  intercorrelations)  of  the  particular 
items  that  happen  to  have  been  chosen  for  the  test,  it  is 
frequently  considered  to  be  advantageous  to  transfora  the 
scale  to  soae  other  system  of  units  that  would  be 
independent  of  the  characteristics  of  the  particular  test 
and,  in  the  sense  of  a  particular  operational  definition, 
equally  spaced."  [Hef.  23:pg.  515] 


Therefore,  the  T-score  is  used. 


3.  Xhe_BagellSS.B3l3 


For  coaparative  purposes  it  is  important  that  the 


baseline  data  used  as  a  uora  be  properly  defined.  The 


baseline  data  essentially  establishes  the  norms  against 


which  a  training  unit  will  be  examined  in  order  to  reflect  a 
relative  perforaance  evaluation.  As  such,  the  items  forming 
this  standard  reference  group  must  be  similar  in  most 
important  respects  to  the  group  being  evaluated  £Ref.  23:pg. 
513]. 


Once  the  NTC  is  operating  at  full  capacity  it  is 


planned  to  rotate  42  battalions  per  year  through  the 


training  programs  there.  Each  battalion  in  the  continental 


OS  will  actually  rotate  to  the  ETC  for  training  once  every 
18  months.  Therefore,  a  to-cal  of  approximately  63  battalions 
will  be  trained  at  the  ETC  every  18  months.  Because  a 
normative  evaluation  is  planned  for  the  TRP,  this  population 
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of  63  previously  trained  battalions  Mould  represent  the  aost 
current  set  of  "noras"  availible  to  a  training  unit.  In 
effect,  a  "aoving  baseline"  is  suggested  here  as  the  aost 
Meaningful  noraative  population. 

is  a  battalion  begins  training  at  the  STC,  a  nee 
baseline  data  set  is  calculated.  The  oldest  battalion  data 
set  would  be  dropped  froa  the  baseline,  while  the  aost 
current  (the  63rd  trained  battalion,  or  the  last  previous 
battalion  data  set)  would  be  added.  Thus,  as  the  first  TBP 
is  calculated  for  the  battalion  in  training,  all  HOB  data 
for  it  would  be  coapared  against  the  previous  (aost  current) 
63  battalion  data  sets  on  file. 

This  "aoving  baseline  data"  would  have  several 
advantages.  First,  it  would  preclude  inter- battalion 
coaparison  and  eliainate  any  possibility  of  "grading" 
between  battalions  in  training.  Each  battalion  would  be 
coapared  against  a  new  set  of  noras.  Thus,  relating  one  TBP 
to  another  would  render  no  aeaningful  coaparison.  The 
coaparative  evaluation  provided  to  the  training  battalion, 
however,  would  still  be  aeaningful  as  it  would  relate 
current  unit  perforaance  to  the  recent  perforaance  of 

unit  peers.  This  would  still  allow  brigade  or  higher 
coaaanders  to  establish  training  priorities  by  using  several 
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TBPs,  for  although  no  unit  comparison  is  possible,  certainly 
trends  can  be  identified. 

Secondly,  such  a  "soring  baseline  data"  set  would 
allow  for  gradual  training  improvement  over  tiae.  Certainly, 
as  OC's  and  TAP  personnel  become  aore  proficient  the 
training  value  of  NTC  exercises  will  increase  and  likewise 
unit  proficiency  will  increase.  By  sequentially  dropping 
and  adding  data  to  the  baseline,  normative  "standards"  will 
rise  gradually  as  the  salutary  effect  of  NTC  training  begins 
to  improve  Army-wide  training  readiness.  Thus,  training 
units  will  not  suddenly  find  the  noras  drastically  different 
froa  cycle  to  cycle.  Units  nay  then  train  in  confidence 
knowing  their  performance  will  be  related  to  the 
accomplishments  of  peer  battalions  sirce  their  last  visit. 
No  particular  data  analysis  would  therefore  be  required  in 
order  to  maintain  the  data  base — the  baseline  would,  in 
effect,  become  self-maintaining. 

As  with  any  system,  however,  there  are  certain 
problems  inherent  to  the  moving  baseline  data  set.  Changes 
in  TOSS  (organization)  or  equipment  (the  substitution  of  Hi 
tanks  for  H48A5  tanks,  etc.)  are,  in  effect,  changes  in  the 
population .  Data  collected  froa  such  units  will  not  be 
compatible  with  the  data  base  as  originally  established  and 
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will  incorrectly  influence  the  norms.  Thus,  new  units  aust 
be  treated  separately  and  new  baseline  data  sets  established 
for  thea. 

it  the  current  tiae  in  Phase  I  of  the  HTC,  it  is 
planned  to  only  instruaent  araor-heawy  battalion  task  force 
teaas  in  training  at  the  HTC.  Thus,  a  homogeneous 
population  for  the  baseline  is  initially  insured,  When 
mechanized  infantry  task  forces  are  fully  instrumented  at  a 
later  date,  their  data  may  prove  to  be  incommensurate  with 
armor- heavy  TF  data.  Since  both  battalions  use  the  same 
types  of  equipment  (and  differ  only  in  the  quantity 
authorized)  the  "normalizing"  effect  of  the  MOEs  chosen  for 
the  TRP  (see  chapter  3)  may  eliminate  this  problem. 

However,  this  fact  must  be  analyzed  and  verified  before  data 
froa  both  types  of  units  can  be  coaingled  in  the  baseline 
data  set. 

These  questions  can  be  settled  by  examining  NTC 
instrumented  data  as  it  becomes  available.  The  "moving 
baseline  data"  set  concept  is  sound,  and  can  undoubtedly  be 
implemented  once  these  initial  questions  are  resolved. 

It  is  instantly  recognizable,  however,  that  a  T- 
score  is  unacceptable  for  psychological  reasons  as  an 
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indicator  of  unit  relative  perforaance.  The  simple  use  of 
the  word  "scores'*  is  enough  to  conjure  up  ghostly  visions  of 
the  old  ATT  and  OBTT  graded  systems  which  the  Aray  has 
eliainated.  Any  evaluation  aethod  such  as  is  proposed  here 
aust  scrupulously  avoid  the  appearance,  however  slight,  of  a 
graded  result.  It  aust  be  reaeabered  that  the  calculated  T- 
score  is  WOT  a  "score"  or  "grade",  but  rather  a  convenient 
aethod  of  reflecting  and  standardizing  a  auaber  to  represent 
relative  perforaance.  Therefore,  although  the  T-score  is 
statistically  a  very  useful  result  (and  can  provide  a  wealth 
of  data  to  an  operations  research  analyst)  the  final 
evaluation  aust  be  presented  to  the  unit  coaaander  in  a 
different  format. 

One  solution  to  this  problea  is  the  use  of  decile 
evaluations.  The  T-score  is  a  normalized  statistic  and  thus 
reflects  a  position  on  the  normal  curve.  If  the  area  under 
the  normal  curve  was  subdivided  into  ten  equal  proportions 
of  area,  it  would  fora  deciles  (see  Figure  12).  This  fora 
of  partitioning  is  very  similar  to  the  stanines**  method 
used  by  the  Aray  Air  Force  in  WWU  for  personnel  evaluation. 


**"Stanines"  was  a  general  standard  score  svstea 
developed  by  USAAF  psychologists  for  use  in  WWll.  The  plan 
divided  the  normal  population  into  nine  groups,  or  "standard 
nines".  The  result  was  a  distribution  with  a  mean  =  5.0  and 
a  standard  deviation  *  2.0.  (  Bef .  26: pg.  128] 
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Figure  12:  Deciles 

Once  this  decile  subdivision  has  been  accomplished, 
the  T-score  for  each  SOS  can  be  placed  on  the  curve  into  its 
appropriate  decile.  This  decile  evaluation  of  relative 
oerforaance  can  then  be  provided  to  a  unit  cossander  without 
any  appearance  of  a  score  and  its  associated  stigsa. 

Thus,  when  several  SOEs  are  displayed  in  bar  graph 
style  side-by-side.,  comparisons  of  relative  perforsance  in 
each  of  the  areas  becoaes  easy  and  alaost  immediately 
obvious.  &n  BOB  where  a  unit  perforas  high  in  a  relative 
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comparison  will  be  represented  in  one  of  the  upper  deciles 
while  an  area  of  relatively  low  performance  will  be  shown  by 
a  bar  in  the  lower  deciles. 

This  system  is,  of  coarse,  somewhat  circular.  This 
same  information  could  be  conveyed  to  the  unit  commander  by 
utilizing  the  straight  percentage  calculation  initially 
discussed.  However,  if  the  problems  of  "unsmooth"  data 
occur,  or  if  the  data  turns  out  to  be  sparse,13  then  the  T- 
score  method  will  allow  for  meaningful  statistical  analysis 
of  unit  performance  whereas  the  percentile  evaluation  will 
not.  Additional  benefits  also  accrue  from  the  use  of  T- 
scores  and  deciles  in  the  field  of  statistical  analysis  (see 
Chapter  5  for  discussion) . 

Thus,  the  decile  evaluation,  coupled  with  the  use  of 
T-scores  provides  a  meaningful,  normative  evaluation  which 
facilitates  analysis  to  identify  areas  of  training 
deficiencies.  In  turn,  this  helps  in  resource  allocation 
and  highlights  the  direction  of  remedial  training.  A 
further  benefit  of  this  normalized  system  is  that  it  relates 
relative  performance  between  the  various  measured  HOEs  to 
the  commander. 

l3That  is,  if  many  units  achieve  identical  numerical 
totals  for  the  various  HOE.  In  this  situation,  the  data 
provides  no  real  information  about  the  actual  distribution 
of  the  HOE. 
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This  is,  indeed,  a  necessary  endeavor,  for  as  the 


educational  community  dicovered  decades  ago: 


"An  individual's  test  score  acquires  leaning  when  it  can 
be  compared  with  the  scores  of  well-identified  groups  of 
people.  Hanuals  for  tests  provide  tables  of  noris  to  sake 
it  easy  to  coipare  individuals  and  groups,  several 
systeis  for  deriving  lore  seaningful  "standard  scores” 
froa  raw  scores  have  been  widely  adopted,  ill  of  thei 
reveal  the  relative  status  of  individuals  within  a  group." 
[Ref.  26:pg.  1] 


Given  the  great  value  of  the  statistically  reliable 


intonation  delivered  by  the  NTC,  the  iny  can  do  no  less. 


To  do  otherwise  is  to  discard  hard-won,  expensive  data 


which,  if  properly  and  completely  analyzed,  could  ultimately 


save  lives  in  combat. 


B.  THE  TRAINING  READINESS  PROFILE  STRUCTURE 

The  quantitative  measures  used  to  provide  an  objective 
unit  evaluation  and  the  underlying  theory  for  showing 
relative  performance  have  been  given.  The  next  step  in  this 
process  is  to  explain  how  these  measures  of  performance  can 
be  displayed  for  a  unit  commander.  It  is  important  that  any 
presentation  be  concise  yet  thorough;  that  is,  address  the 
main  issues  of  training  performance  and  avoid  minute 
details.  Numbers  that  reflect  actual  as  well  as  relative 
performance  will  assist  the  commander  in  identifying  areas 
for  future  training.  Any  representation  should  be  easy  to 
understand  and  interpret  so  it  can  serve  as  an  aid  to  the 


108 


coaaander  and  his  staff  ever  after  retar ning  to  their  hose 
station.  The  reaainder  of  this  section  Hill  outline  a 
structure  for  displaying  the  IK.  For  ease  in  understanding 
the  structure  a  saaple  TBP  is  presented. 

The  TBP  Hill  consist  of  four  separate  pages.  The 
first  page  Hill  display  the  unit  perfornance  nith  respect  to 
overall  aission  accoaplishaent.  The  other  pages  vill 
reflect  the  unit  perforaance  in  its  ability  to  shoot,  aove, 
and  coaaunicate.  So  direct  correlation  exists  betveen  the 
four  separate  pages.  However,  specific  HOEs  that  portray 
Ion  perforaance  on  one  page  nay  be  further  explained  or 
supported  by  HOEs  on  a  different  page.  An  exaaple  of  this 
relationship  is  provided  in  the  saaple  TBP. 

Each  page  is  constructed  and  presented  in  the  saae 
aanner.  The  top  of  the  page  is  titled  to  provide  the 
exercise  segaent  conducted  by  the  unit  (attack,  defend, 
etc.) .  Onder  this  title  is  the  functional  area  covered  by 
the  page:  aission  accoaplishaent,  shoot,  move,  or 
coaaunicate.  Following  this,  there  is  a  bar  chart  that 
shows  the  various  HOEs  for  that  functional  area  along  the 
abscissa.  Listed  with  each  HOE  are  the  actual  nuabers  used 
to  coapute  the  value  of  that  HOE.  The  decile  increaents  are 
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displayed  on  the  ordinate  axis.  Above  each  HOE  is  a  bar 
that  shows  the  performance  of  this  unit  relative  to  the 
units  considered  in  the  data  base.  The  "shoot"  page  has 
three  bars  for  each  NOE;  each  bar  depicts  a  different  weapon 
type. 

Interpreting  the  results  shown  on  the  bar  graphs 
will  lead  to  the  identification  of  training  weaknesses.  In 
all  cases,  a  bar  that  fits  in  the  lower  decile  areas 
indicates  that  relative  to  baseline  perforaance,  this  unit 
has  a  training  weakness.  Some  MOEs  are  defined  so  that  a 
seall  nueber  is  better  (e.g.  all  NOE  in  the  coeaunicate 
area) .  The  TRP  is  constructed  to  accoaodate  this  fact. 

Units  with  higher  numbers  will  be  placed  in  the  lower 
deciles.  The  key  to  understanding  these  graphs  is  in 
realizing  that  any  bar  above  the  5th  decile  aeans  this  unit 
performed  better  than  average,  relative  to  the  baseline 
data.  Likewise,  any  bar  in  the  lower  deciles  reflects  the 
fact  that  this  area  needs  further  training,  relative  to 
Army-wide  norms. 

This  system  allows  the  commander,  at  a  glance,  to 
identify  areas  of  perforaance  that  contain  training 
weaknesses.  The  commander  can  then  concentrate  his  efforts 
and  conduct  a  more  thorough  analysis  of  this  area.  Using 


110 


the  d-etailed  data  collected  by  the  NTC  instr uaentation  a 
aore  specific  listing  of  soldier  and  unit  tastes  can  be 
identified  for  reaedial  training. 

2.  saaple  TEP 

The  following  pages  depict  the  TEP  that  could  be 
generated  for  a  typical  tank  heavy  battalion  task  force 
training  at  the  NTC.  Nuabers  shown  on  the  saaple  THP  are 
ficticious  and  are  not  intended  to  represent  any  particular 
unit.  The  analysis  accoapanying  each  page  of  the  TEP  is 
taken  fron  the  displayed  results  and  represents  a  possible 
interpretation.  The  general  context  of  the  consents 
concerning  unit  perforaance  are  available  froa  proper 
interpretation  of  the  TEP.  Some  specific  iteas  in  the 
coaaents  would  require  aore  justification.  In  the  case  of  a 
real  unit  being  evaluated  at  the  NTC  the  actual  nuabers  to 
support  these  coaaents  would  be  readily  accessible  through 
recorded  radio  nets,  video  tapes  of  activities,  or  froa 
events  recorded  by  the  instr uaentation. 

Before  discussing  each  TEP  page  it  would  be  helpful 
to  obtain  a  clear  understanding  of  what  is  depicted.  The 
nuabers  shown  below  each  NOE  reflect  actual  unit 
perforaance.  As  an  exaaple,  in  the  area  of  aission 
accoapl  ,sha9nt  (see  Figure  15),  the  friendly  force  killed  18 
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of  the  30  OPFOB  cosbat  vehicles  and  239  of  the  425  OPPOB 
personnel  that  started  the  exercise  segment.  The  length  of 
the  bar  above  each  HOE  represents  how  well  this  unit 
perforaed  relative  to  the  units  considered  in  the  data  base. 
Since  a  data  base  is  currently  nonexistent  the  displayed 
results  were  deterained  by  assuaing  a  hypothetical  data 
base.  Exaaples  of  the  calculation  for  relative  performance 


are: 


Killing  18  of  30  OPFOB  vehicles  (or  60 X)  places  this  unit 
so  that  56%  of  the  units  in  the  data  base  killed  a  lower 
percentage.  Therefore,  pa. 56  and  froa  the  normal  curve 
table  z— .15.  This  produces  a  T-score  of  51.5  and 
reference  to  Pigure  15  shows  this  score  to  be  in  the  6th 
decile  as  depicted  on  the  TRP. 


Killing  239  of  the  425  OPFOB  personnel  (or  56%)  places 
this  unit  so  that  62%  of  the  units  in  the  data  base  killed 
a  lower  percentage.  Therefore,  p*.62  and  from  the  normal 
curve  table  z*.305.  This  produces  a  T-score  of  53.05  and 
reference  to  Pigure  15  shows  this  score  to  be  in  the  7th 
decile  as  depicted  on  the  TBP. 


A  sample  TBP  follows  and  is  given  with  a  possible 


interpretation  for  the  various  category  pages. 


a.  Hission  Accomplishment  (Pigure  13) 

This  unit  perforaed  well  in  killing  the  OPFOB, 
both  vehicles  and  personnel.  This  high  level  of  performance 
in  both  areas  coabined  to  produce  an  even  higher  overall 


OPFOB  loss  value  than  expected.  From  the  HOE  #8  it  seems 
the  unit  moved  very  quickly  through  the  exercise  segment. 
Relative  to  other  units  this  unit  lost  a  high  percentage  of 
friendly  vehicles  and  personnel,  but  the  lowest  area  is  HOE 
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figure  13:  Sample  Mission  Accomplishment  T HP  Page 

•4,  loss  of  vehicles.  Sven  though  the  friendly  force 
sustained  a  large  percentage  of  casualties,  MOB  #7,  the 
relative  loss  exchange  ratio,  was  not  uncosf ortably  low 
since  the  friendly  force  was  able  to  inflict  heavy  losses  on 
the  OPFOB.  Possible  reasons  for  the  areas  of  relatively  low 


performance  aigbt  include  (and  can  be  supported  with  OC 
coaaents) : 

The  unit  was  moving  too  fast  to  allow  vehicles  to  use 
proper  movement  techniques. 

The  vehicle  drivers  and  coaaanders  were  not  trained  well 
enough  on  the  use  of  terrain  for  cover  and  concealaent  to 
aask  aoveaent. 

Since  the  unit  aoved  so  fast  there  was  insufficient  tiae 
to  place  forges  in  overwatch  positions  to  provide 
protecting  fires. 

These  reasons  are  not  all  inclusive  of  the  possibilities  and 
any  be  incorrect.  The  other  THP  pages  need  to  be  ezaained 
to  determine  if  any  of  these  possibilities  have  aerit. 
b.  Shoot  (Pigure  14) 

The  tanks  and  TOHs  fired  fewer  rounds  than 
normally  observed  for  this  type  of  action  while  the  Dragons 
seeaed  to  fire  aore.  With  respect  to  weapons  proficiency, 
it  appears  that  the  tank  gunners  did  not  kill  or  hit  aany 
OPFOR  targets  (HOE  #5)  relative  to  the  norm.  However,  the 
percentage  of  near  misses  was  relatively  high,  which  aeans 
the  tank  gunners  had  identified  the  targets,  but  were  not 
shooting  accurately.  Input  froa  the  field  controllers 
indicated  that  since  the  unit  was  aoving  so  quickly  aost 
tanks  were  firing  on  the  move.  This  unit  aight  need 
additional  gunner  training  to  shoot  while  aoving.  In  the 
actual  data  it  was  found  that  the  tanks  killed  10  of  the  18 
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OPPOB  vehicles  daring  the  exercise.  This  say  sees  good*  but 
relative  to  other  nnits  the  tanks  usually  accounted  for 
approriaat ely  70V  of  the  OPPOB  vehicles  killed.  BOB  #5 
(weapons  fractional  kill  effectiveness)  indicates  that  the 
Dragons  killed  aany  sore  eneay  vehicles  than  usual  while 
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both  the  tanks  and  TOfls  were  low  killers  in  relative  tens. 
By  referring  to  the  battalion  operations  order  and  position 
locations  of  various  players,  it  was  determined  that  the 
coeaar.der  led  his  aoveeent  with  the  infantry,  thereby 
allowing  Dragon  gunners  aany  wore  shots  at  the  OPFOB.  This 
resulted,  however,  in  the  friendly  force  losing  several  of 
their  own  vehicles  since  friendly  tanks  were  behind  the 
infantry  and  not  in  a  position  to  return  fire  on  the  OPFOB. 
The  player  position  plots  revealed  that  TOBs  were  not 
eaployed  froa  available  over watch  positions.  Bather,  they 
were  used  with  the  leading  aanenver  element  and  thus  their 
capabilities  were  limited. 

c.  Hove  (Figure  15) 

Froa  the  mission  accomplishment  page  it  is  known 
that  the  unit  finished  the  exercise  segment  quickly.  This 
is  confirmed  by  the  depicted  movement  rates.  Comparing  the 
two  rates,  it  can  be  seen  that  the  unit  followed  a  fairly 
direct  route.  They  only  travelled  20  kilometers,  and  there 
was  16  kilometers  straight  line  distance  froa  Company  A's 
start  point  to  its  designated  objective.  A  map  study 
revealed  a  different  route  that  was  slightly  longer  but 
could  have  provided  more  rolling  terrair  for  concealment. 

The  leading  companies  conducted  a  well  coordinated  movement 
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Figure  IS:  Saaple  Bove  TBP  Page 


and  protected  each  others  flanks.  Relative  to  other  units  a 
good  portion  of  the  friendly  force  reaained  in  contact  with 
the  OPFOB.  This  pressure  sight  have  been  the  cause  of  the 
aneay  withdrawing  in  a  fashion  that  left  his  vehicles 
exposed  to  friendly  fir a.  Operational  readiness  was 
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relatively  low  and  a  check  with  observer/controllers 
indicated  that  4  of  the  6  vehicles  lost  for  maintenance  were 
lost  because  of  improperly  Maintained  oil  levels, 
d.  Coaaunicate  (Figure  16) 

Relative  to  other  units,  the  nuaber  and  duration 
of  radio  transaissions  was  good.  All  areas  of  coaaunication 
seea  to  be  fine  with  the  exception  of  radio  transaission 
length,  or  HOE  #4  (transaissions  greater  than  55  seconds) . 
Bach  company  contributed  to  this  count  of  5  messages.  By 
referring  to  recorded  radio  nets,  it  was  determined  that 
these  lengthy  transaissions  were  caused  by  company 
headquarters  sending  the  operations  order  to  their  platoons. 
The  OPFOH  controllers  indicated  the  OPFOE  was  able  to 
identify  some  friendly  locations  and  suraised  that  increased 
radio  traffic  indicated  an  operation  about  to  begin.  The 
OPPQR  reacted  quickly  and  was  able  to  position  aore  forces 
to  the  front  of  the  known  friendly  locations.  They  did  not 
have  aaple  tiae  to  construct  prepared  positions,  however, 
due  to  the  fast  aoveaent  of  the  friendly  force.  This  caused 
the  OPFOR  vehicles  to  leave  their  fighting  positions  sooner 
than  they  desired,  and  thus  they  exposed  theaselves  to 
friendly  fire. 
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Figure  16:  Saaple  Coaao  IBP  Page 

The  foregoing  ezaaple  IBP  and  its  accoapanying 
analysis  is  intended  to  deaonstrate  how  the  IBP  coaid  be 
utilized  to  assist  the  battalion  coasander  in  reaping  the 
aaxiaaa  training  benefit  froa  the  MIC.  The  IBP  is  envisioned 
as  being  incorporated  in  the  after  action  review  and  is  not 


intended  to  replace  the  foraal  Aha.  The  TBP  should  be 
presented  and  explained  in  detail  at  the  AAB  to  insure  that 
unit  coaaanders  can  best  utilize  the  document  for  hoae 
station  training.  The  intended  priaary  recipient  of  the  TBP 
is  the  battalion  coaaander  and  his  subordinates,  as  these 
training  aanagers  are  directly  responsible  for  troops — and 
the  accoaplishaent  of  the  real  aission:  the  application  of 
coabat  power  against  the  eneay  in  war. 
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THE  TBP 


A  key  point  stressed  throughout  this  paper  is  that  the 
NTC  exists  for  the  purpose  of  trailing  heavy  battalion  task 
forces.  In  the  train-evaluate-train  cycle,  the  evaluation 
must  be  accurately  directed  at  training  weaknesses.  The 
unit  can  then  use  this  evaluation  to  guide  its  future 
training  and  resource  allocation.  It  has  already  been 
demonstrated  how  the  T8P  helps  to  identify  the  areas  of 
training  deficiency.  The  issues  of  concern  now  focus  on  the 
question  of  how  will  the  THP  aid  the  commander  as  training 
levels  improve  over  time  or  as  new  areas  of  performance  are 
considered  in  the  evaluation  process.  Acceptable  levels  of 
performance  can  be  established  and  checks  should  be  made  to 
insure  the  unit  evaluation  is  being  based  on  meaningful 
measures  of  effectiveness.  Techniques  for  expanding  and 
using  the  TBP  to  address  these  issues  will  be  covered. 

Although  it  has  not  been  emphasized  so  far,  the  NTC  has 
a  secondary  mission  to: 

"Gather  information  to  help  improve  doctrine,  tactics, 
training  system,  equipment,  ana  procedures.  This 
information  also  assists  tne  Army  in  relating  resources  to 
readiness."  [Ref.  13:pg.  1] 

It  is  proposed  to  use  a  trend  analysis  of  the  NTC  data  for 
assessing  current  Army  efforts.  The  TBP  presents  an  ideal 
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structure  for  summarizing  relative  unit  perforaance  trends, 
this  allows  for  easy  ccaparison  of  perforaance  for  different 
years  or  any  desired  tiae  fraae.  1  brief  discussion  of  the 
TBP  usefulness  in  this  area  will  be  provided. 

A.  ESTABLISHING  COHBAT  PERFORMANCE  STANDARDS 

Despite  the  inherent  advantages  and  usefulness  of  the 
noraative  evaluation,  this  type  of  evaluation  has  one  aajor 
deficiency:  it  does  not  follow  the  pattern  aandated  for 
Aray  training  in  the  perforaance  oriented  training  (POT) 
systea . 

The  POT  systea  requires  that  an  eleaent's  actions  be 
cospared  against  a  fixed  standard,  and  that  training  will 
continue  until  the  standard  is  achieved.  It  has  previously 
been  pointed  out  that  although  this  process  is  fairly  easy 
to  follow  for  tha  individual  soldier,  it  beccaes 
increasingly  difficult  to  do  as  the  element  grows  larger  in 
size  (see  Figure  4).  in  fact,  one  reason  given  in  support 
of  the  TBP  was  that  such  objective  standards  say  be 
impossible  to  set  for  the  synergistic  action  cf  battalion 
level  combat.  It  would  be  difficult  to  say  that  a  battalion 
which  siezed  the  objective,  captured  85*  of  an  enemy  force, 
and  hilled  10%  had  failed  to  accomplish  their  mission. 
However,  this  could  be  the  absurd  judgement  made  if  the 
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"minimum  enemy  casualty*4  standard  for  this  particular 
exercise  was,  say,  30%.  The  point  here  is  that  there  aay  be 
an  infinite  set  of  coabinations  of  standards  which  would 
lead  to  victory.  There  is  reason  to  believe,  however,  that 
a  few  fixed  standards,  if  applied  with  coaaon  sense,  can  be 
developed  to  reflect  ainiaua  acceptable  perforaance  (HAP) 
levels.  The  TBP  can  be  singularly  useful  in  doing  this  as 
it  begins  with  a  finite  set  of  "coabinations  of  standards'* 
in  the  baseline  data. 

1 .  Determining  standards 

The  problea  of  deteraining  standards  for  perforaance 
at  the  HTC  has  already  been  considered  by  Headquarters,  os 
Army  Training  and  Doctrine  Coaaand  (TRADOCi  .  Indeed,  a 
model  has  been  proposed  for  this  process  (see  Figure  17) . 

The  initial  analysis  of  this  aodel  has  been  completed,  and 
only  the  qualitative  application — the  actual  setting  of 
standards — remains  to  be  done.  The  next  and  last  phase 
planned  is:  "Ef forts. . .will  be  to  integrate  the  initial 
analysis  with  the  realities  of  actual  operations."  [Ref. 
1h:pg.  III-10].  A  great  deal  of  work  has  gone  into  the  top- 
down  analysis  for  subtasking  the  combat  process  (see  Chapter 
2  and  Appendix  C) .  Therefore,  all  that  remains  to  be  done 
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is  the  integration  of  reality  and  analysis.  It  is  in  this 
area  that  the  TRP  can  provide  read  assistance. 

There  are  basically  three  aethods  which  can  be  ased 
to  set  "fixed1'  numerical  standards.  The  first  nethod 
consists  of  the  normative  approach  already  proposed.  Using 
the  TRP,  the  baseline  data  set  can  provide  an  average  value 
for  every  HOE  used  in  the  evaluation.  If  all  units  are 
accomplishing  their  assigned  missions,  and  subjective1* 
analysis  reveals  that  pertinent  indicator  NOE  values  are 
within  the  desired  range  (casualties,  percent  enemy  hilled, 
rounds  expended,  etc.),  then  pure  BOE  average  values  can  be 
used  as  a  standard.  Basically,  this  amounts  to  a  validation 
of  both  the  normative  THP  system  and  the  current  Army 
organization,  doctrine,  and  training. 

If,  on  the  other  hand,  the  average  values  of  BOEs 
prove  to  be  unacceptable,  then  a  second  system  can  be 
employed.  A  subjective  search  of  the  baseline  data  could  be 
undertaken  to  find  those  units  whose  performance  in  all  or 
most  of  the  HOEs  was  above  a  fixed  decile  level,  say,  the 
7th  decile  as  an  example.  An  average  of  the  HOE  values 

1 'These  judgements  must  by  nature  be  subjective,  and  the 
perogative  of  the  Army's  senior  (general)  officers.  If  the 
BTC  process  is  accepted  as  being  representative  of  real 
combat,  then  such  decisions  as  wfcat  constitutes  "acceptable" 
casualties  must  be  made  at  the  highest  policy  setting 
levels . 
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recorded  for  these  anits  could  be  takes  and  these  nuabers 
eaployed  as  a  standard  for  the  various  HOEs.  This  aethod 
rests  upon  the  theory  that  well-trained  units  perfora  aost 
operations  well,  and  any  unit  which  is  evaluated  at  or  above 
the  7th  decile  in  aost  HOEs  could  be  considered  well- 
trained.  Units  with  high  norale,  esprit,  and  cohesion 
generally  perfora  at  a  high  level  aost  of  the  tine.  The 
perforaance  of  a  less  well-trained  unit  would  tend  to  be 
nore  sporadic  by  NOE. 

A  third  aethod  for  assessing  standards  froa  the  TBP 
would  be  a  coabination  of  the  previous  two.  For  soae  HOEs 
the  straight  baseline  average  value  night  be  acceptable  and 
for  others,  the  "search  out  the  best  units"  technique  could 
apply. 

Certainly,  in  eaploying  any  of  these  techniques,  the 
subjective  assessaent  of  senior  Arny  officers  nust  also  be 
injected.  As  an  exanple,  the  NTC  Coaaander  sight  feel  that 
units  are  failing  to  aggressively  conduct  operations  and  are 
overall  suffering  an  unacceptably  high  level  of  casualties. 
The  standards  for  casualties  sustained  could  be  arbitrarily 
raised  to  establish  a  training  goal  for  units  to  achieve. 
This  is  well  within  the  perogative,  and  indeed  is  the 
responsibility,  of  the  NTC  Coaaander  or  other  aore  senior 


commanders.  In  fact,  the  TBP  system  possesses  such 
flexibility  that  it  would  be  possible  for  large  unit 
commanders  (perhaps  division)  to  set  their  own  unit 
standards  for  training.  This  standard  could  also  be 
reflected  on  the  THP  to  provide  one  additional  piece  of 
inforaation  for  training  assessaent  to  the  training 
battalions,  i  aethod  for  displaying  these  standards  will  be 
provided  in  the  following  section. 

It  should  be  apparent  froa  the  above  discussion  that 
standards  for  unit  performance  can  and  should  be 
established.  Whatever  methodology  is  employed,  the  TBP 
structure  and  concept  provide  a  useful  asset  in  determining 
the  nuabers.  Once  standards  are  set,  they  can  be  revised  as 
deeaed  necessary. 


It  has  already  been  demonstrated  how  the  TBP  will 
assist  a  commander  in  identifying  training  weaknesses.  This 
i3  a  tremendous  asset  to  the  coaaander  when  he  develops  tne 
unit  training  calendar  and  allocates  vital  resources.  The 
benefit  of  the  TBP  relative  performance  indicator  has  been 
discussed.  It  provides  the  commander  with  an  objective 
assessaent  depicting  which  areas  of  his  unit  need  the  most 
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training  as  well  as  his  unit  performance  relative  to  other 
units  who  trained  at  the  HTC. 

There  is  another  important  piece  of  information  that 
can  be  displayed  on  the  TBP.  Once  the  minimum  acceptable 
performance  (HA?)  levels  have  been  established,  as  outlined 
in  the  previous  section,  they  should  be  reflected  on  the 
TBP.  A  commander  is  certainly  concerned  about  the  relative 
performance  of  his  unit  for  various  training  areas,  but  it 
is  not  sufficient  to  perform  at  an  upper  decile  level  if  the 
minimum  standard  has  not  been  achieved.  Likewise,  a  unit 
may  be  assessed  at  a  low  decile  level  of  performance,  but  if 
the  minimum  standard  was  still  accomplished  the  commander 
can  concentrate  training  efforts  in  areas  where  the  HAP  was 
not  achieved.  This  will  serve  as  an  additional  aid  to  the 
commander  in  prioritizing  his  allocation  of  limited 
resources  for  training. 

Portraying  this  standard  can  be  accomplished  with 
minimal  effort.  It  can  be  reflected  in  a  manner  to  make  TBP 
interpretation  easier  and  more  meaningful.  As  all  HOBs  are 
defined  separately,  an  independant  HAP  should  be  established 
for  each  HOE.  Given  a  number  that  represents  the  HAP  for  a 
specified  HOE,  it  will  be  compared  against  the  current  data 
base  to  find  the  percentage  of  units  that  did  not  perform  at 


or  above  this  level.  This  percentage  becoaes  the  "p-value" 
used  to  convert  the  HAP  nuaber  to  a  T-score.  A  horizontal 


dash  will  be  drawn  in  the  NOS  colnan  at  the  decile  rating 
associated  with  the  calculated  T-score. 

To  provide  a  better  understanding  of  the  HAP 
concept,  the  coaaunicate  TBP  page  froa  the  saaple  in  chapter 
3  has  been  reproduced  below.  Hypothetical  standards  have 
been  established  and  are  depicted  on  the  TBP.  A  calculation 
to  deteraine  the  HAP  plotting  level  has  been  shown. 

Finally,  interpretive  coaaents  have  been  provided  to 
deaonstrate  how  this  additional  itea  of  inforaation,  the 
NAP,  can  aid  a  coaaandex  in  his  training  evaluation 
assessaent. 


For  this  type  unit  in  a  aoveaent  to  contact  aission,  the 
current  standard  is  to  attain  an  average  disseaination 
ti#e  of  10  ainutes.  According  to  the  data  base  19*  of  the 
units  failed  to  achieve  this  standard.  Therfore,  p».19 
and  froa  the  Noraal  curve  table  z*-t878.  This  produces  a 
T-score  of  41.22  and  reference  to  Figure  15  shows  this 
score  to  be  in  the  second  decile  as  depicted  on  the  TBP 
(see  Pigure  18). 


Additional  interpretations  of  the  TBP  page  could  be  as 


follows  (see  Figure  18): 


Even  though  the  unit  did  relatively  well  in  HOE  il 


(average  transaission  duration)  the  HAP  was  sot  achieved. 
One  other  area  which  fell  below  the  HAP  was  HOE  *4  (nuaber 
of  transaissions  exceeding  55  seconds  duration).  If  the 
coaaander  concentrates  efforts  in  training  radio  operators 
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MOVEMENT  TO  CONTACT 
(Communicate) 
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Figure  19:  Saaple  Coaaunicate  TEP  Page  with  UAPs 

to  shorten  aessages  the  radio  transaission  length  will 
decrease  in  both  areas.  This  should  be  priority  one  for 
coaaunication  training. **  The  unit  perforaed  relatively  well 

„  .l*The  coaaander  aust  still  assess  a  training  resource 
tradeoff  between  aajor  areas,  weapons  proficiency  and 
coaaunications  for  exaaple.  This  decision  should  be  aided 
by  the  aission  accoaplishaent  TEP  page  and  the  overall 
exercise  evaluation  provided  by  the  TAP. 
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in  HOE  *2  and  #3.  It  should  be  noted,  however,  that  the  HAP 
was  barely  achieved  and  this  training  area  should  receive 
second  priority.  In  the  other  categories  being  evaluated 
the  unit  not  only  perforaed  relatively  well,  but  also 
exceeded  the  HAP.  These  areas  do  not  require  additional 
training  resources.1* 

The  establishaent  of  HAPs  and  the  benefit  they 
provide  has  already  been  discussed.  To  serve  this  useful 
purpose,  however,  requires  that  qualitative  standards 
developaent  be  a  continuing  process.  Bevisions  to  the  HAPs 
are  necessary  for  two  reasons:  the  Aray  force  structure  or 
operating  procedure  nay  change,  and  hopefully,  units  will 
becoae  trained  to  a  higher  level  of  proficiency. 

Arny  combat  developments  activities  are  constantly 
analyzing  weapons  systems,  tactics,  doctrine,  etc.  as  used 
by  our  forces,  to  determine  if  they  can  be  improved.  tfhen 
improvements  to  combat  effectiveness  are  possible  the 
procurement  of  a  new  weapon  system  or  an  appropriate  change 
to  tactical  employment  may  be  initiated.  The  improved 

>*Althogh  not  depicted  on  this  TBP  page  there  might  be 
an  occassion  when  a  unit  performance  is  relatively  low,  but 
3till  achieves  the  HAP.  areas  where  the  HAP  was  not 
achieved  should  receive  further  training  emphasis  before  an 
area  where  the  HAP  was  achieved,  even  if  relative 
performance  was  low. 
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effectiveness  usually  Beans  a  better  perforaance  capability 


of  the  friendly  force. 17  By  natural  extension  of  reasoning, 
this  should  aean  that  the  standard  for  unit  perforaance 
should  be  raised. 

The  purpose  of  the  NTC  is  to  provide  a  location 
where  heavy  battalion  task  forces  can  conduct  realistic 
training.  As  units  train  at  the  NTC  they  will  be  provided 
with  an  assessaent  that  outlines  their  training  weaknesses. 
If  coaaanders  use  this  asset  to  develop  training  plans  they 
will  certainly  allocate  resources  to  the  areas  that  reguire 
the  aost  iaproveaent  to  attain  the  SAP.  This  will  hopefully 
produce  units  that  are  nore  coabat  proficient  in  these  areas 
(see  Pigure  7).  As  the  level  of  training  iaproves  the 
standard  for  unit  perforaance  aay  be  raised. 

B.  CHANGING  TH3  BASIS  OF  EVALUATION — SELECTION  OF  NEW  HOES 

An  assessaent  of  unit  perforaance  is  based  on  the  areas 
that  are  observed  and/or  aeasured.  The  assessaent  is  only 
aeaningful  when  it  reaains  within  the  liaits  of  the  areas 
observed  and  the  aeasureaents  taken.  A  unit  evaluation 
coapiled  froa  the  TBP  is  derived  froa  the  analytical  base  of 

* 7 Cost  and  operational  effectiveness  analyses  conducted 
by  the  Arav  are  a  prise  exaaple  of  this.  Before  a  new 
systea  is  developed  it  aust  be  deterained  that  the 
additional  effectiveness  provided  to  the  force  by  the  systea 
is  worth  the  cost  required. 
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the  THP,  that  is,  the  defined  HOEs.  The  coeplete  unit 
assessment  is  supported  by  other  collected  data,  but  the 
HOEs  provide  the  eain  direction  for  an  evaluation. 

Therefore,  any  aeaningful  assessment  of  unit  performance 
should  be  limited  to  the  areas  addressed  by  the  selected 
HOEs. 

Bhen  the  HOEs  were  presented  in  Chapter  3  it  was  noted 
that  there  was  no  unique  set  of  measures  to  use  for  an 
evaluation.  The  current  TRP  graphs  have  been  outlined  for 
the  purpose  of  assessing  unit  performance  in  the  areas  of 
mission  accomplishment,  shoot,  move,  and  communicate.  If 
specific  functions  in  these  areas  are  to  be  asessed  then  the 
HOEs  can  be  redefined  to  measure  selected  items  of 
performance  in  greater  detail,  i.e.,  through  more  detailed 
subtask  analysis.  As  the  data  collection  capability  of  the 
NTC  expands,  the  span  of  evaluated  functional  areas  can  be 
increased.  Under  the  present  TBP  structure  the  subjective 
input  of  the  controllers  is  not  directly  incorporated  into 
the  unit  assessment,  but  this  can  be  done.  Each  of  the 
enhancements  mentioned  here  will  be  discussed  in  the 
following  sections. 
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The  HOEs  defined  for  use  with  the  TBP  should  be 


1. 

viewed  as  an  initial  starting  base.  They  were  selected 
because  collectively  they  provide  a  measure  of  overall  unit 
tactical  performance.  These  HOEs  should  assist  in 
establishing  meaningful  standards  for  acceptable  levels  of 
performance. 

As  the  level  of  training  improves  across  the  &rmy, 
more  and  more  units  will  achieve  the  HAP  level  for  certain 
HOEs.  A  "significance  analysis"  of  those  HOEs  should  be 
conducted  on  a  routine  basis  to  determine  when  all  or  most 
units  are  regularly  attaining  the  desired  standard.  When 
most  units  have  attained  the  HAP  level  for  an  HOE ,  the  HOE 
tends  to  lose  importance  or  significance  in  the  evaluation 
process,  i.e.  it  does  not  provide  an  indicator  of  training 
deficiencies.  If  this  situation  occurs,  the  HOE  should  be 
considered  for  elimination  from  the  TBP.  This  change  can  be 
accomplished  from  cycle  to  cycle  without  regard  for  unit 
scheduling,  as  there  is  no  comparative  value  to  the  TRP. 
Changing  HOEs  from  one  battalion  to  the  next  is  immaterial 
to  the  TRP  concept  as  tha  TBP  is  not  intended  to  be  used  for 
inter-battalion  comparison,  but  rather  as  an  asset  for 
identifying  training  weaknesses.  If  the  units  have  achieved 
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th3  HAP  level  then  their  training  resources  should  be 
directed  to  a  different  area. 

As  soae  MOSs  lose  iaportance  and  are  dropped  froa 

the  TRP,  it  would  becoae  possible  to  incorporate  new 

neasures  without  the  size  of  the  TBP  becoaing  unwieldy. 

Additional  MOEs  aight  focus  on  providing  a  aore  in-depth 

aeasure  of  particular  perfornance  areas.  If  desired,  the 

detailed  top-down  analysis  of  unit  tasks  conducted  for  the 

NTC  could  be  used  to  provide  candidates  for  new  IBP  HOEs. 

Any  HOE  proposed  as  ar.  expansion  to  the  IBP  should  be 

checked  for  the  following  criteria: 

It  aust  possess  an  operational  definition  that  can  be 
aeasured. 

It  must  provide  a  aeasure  for  a  relevant  area  of  unit 
perforaance. 

The  inforaation  gained  from  it  should  not  already  be 
provided  by  soae  other  HOE. 

Provided  these  conditions  are  satisfied,  the  HOE  could  be 
added  to  the  TB?  structure  on  an  appropriate  page. 

The  voluae  of  data  collected  at  the  NIC  will  grow 
quickly  as  the  nuaber  of  training  units  increases.  Once  a 
data  base  has  been  established  an  analyst  can  conduct  a 
correlation  analysis  on  the  various  HOEs.  In  soae  cases, 
two  or  aore  MOEs  may  vary  in  a  related  fashion,  i.  e.  under 
a  given  set  of  conditions  they  change  in  a  proportional 
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Banner,  when  these  relationships  are  found,  the  extent  of 
the  correlation  can  be  deternined.  If  the  degree  of 
correlation  proves  to  be  significant,  then  some  of  the  HOEs 
aay  be  dropped  froa  the  TBP  without  losing  valuable 
information.  This  is  possible  because  the  reaaining  HOEs 
can  be  used  to  estiaate  the  perforaance  in  the  area  of  the 


eliainated  HOE. 

The  aethod  of  correlation  analysis  goes  beyond 
comparing  selected  HOEs.  In  the  sample  TBP  several 
assessments  were  made  that  required  substantiation  froa 
sources  other  than  the  TBP.  The  process  of  relating  these 
other  data  items  to  the  TBP  is  referred  to  as  correlation.1* 
In  the  following  section  it  is  explained  how  subjective 
controller  inputs  and  other  aeasureable  areas  can  be 
structured  into  measurements  for  HOEs.  This  will  assist  in 
the  process  of  correlating  all  available  data  to  produce  a 
more  thorough  evaluation  of  unit  perforaance. 

2.  Scaling  PC  Inputs 

It  the  present  time  the  OC  inputs  determined  at  the 
NTC  are  of  little  statistical  value  (although  of  great  value 


‘•When  the  correlation  involves  subjective  aeasures  of 
only  an  ordinal  or  nominal  scale,  nonparaaetric  tests  of 
correlation  are  available.  See  Siegex  [ Bef .  27]  for  a 
complete  discussion  of  the  Spearman  and  Kendall  correlation 
coefficients  used  for  this  purpose. 
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for  subjective  evaluations).  Certainly  the  oc  plays  a  large 
role  in  the  actual  operation  of  the  HTC,  for  their 
evaluations  provide  not  only  the  standardized  "professional 
evaluator"  feedback,  but  also  provide  the  only  observations 
of  battalion  coaaand  group  operations.  This  in  itself  Bakes 
then  indispensi ble,  for  the  actions  of  the  battalion  coaaand 
group  can  often  deteraine  victory  or  failure  regardless  of 
troop  training  levels. 

The  battalion  coaaand  group  observation  plan  for  the 
HTC  is  veil  thought  out  and  calls  for  the  subjective 
evaluation  of  thirty  different  dOEs  by  the  OC  [Ref.  28]. 
These  HOEs  cover  the  full  range  of  battalion  coanand  group 
operations.  It  is  planned  to  record  the  oc  observations 
froa  this  plan  in  the  CIS  data  base  for  cataloging  and  use 
during  AAHs.  Edited  lists  of  these  coaaents  are  to  be 
provided  to  training  battalions  in  the  take  hoae  package 
(THP)  . 

Two  further  evaluations  are  also  planned  for  the 
battalion  coaaand  group  and  staff.  The  first  is  the 
Battalion  Coaaand  Group/Staff  Evaluation  fora  [Ref.  29:lncl 
l,pg.  26].  This  evaluation  incorporates  dOEs  froa  the 
original  plan  [Ref.  2  8],  but  requires  each  OC  to  rank  the 
battalion  coaaand  group  perforaance  on  a  scale  froa  one  to 
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ten.  The  purpose  in  doing  so  is  mainly  geared  toward 


assisting  the  NTC  in  assessing  trends  in  battalion  training 


and  OC  standardization.  As  the  concept  paper  states: 


"There  is  no  intention  to  use  these  values  as  part  of  the 
feedback  to  the  training  unit.  Analysis  of  these  ratings 
should  not  be  used  to  cospare  one  unit  against  another,  or 
for  the  purpose  of  assigning  a  level  of  perforaance  to  the 
battalion."  [Ref.  28] 


These  ratings  were  designed  to  extract  the  following 


information: 


"a.  OC  reliability  by  cosparison  of  the  assigned  ratings 
and  the  objective  aeasures  from  the  instrumentation. 

b.  Correlation  of  a  selected  HOZ  or  HOP  to  overall 
effectiveness. 


c.  Training  trends  across  all  visiting  battalions.  Once 
a  trend  is  identified  then  a  detailed  testing  plan  can 
be  developed  for  more  detailed  study. 


d.  Measure  the  effectiveness  of  NTC  connand  and  control 
training  of  unit  by  graphing  the  ratings  over  time." 
[ R ef .  2o] 


However,  there  is  a  great  deal  more  information  contained  in 


this  evaluation  if  it  can  be  gleaned  from  the  raw  data.  One 


of  the  key  components  of  the  statistically  significant 


evaluation  is  the  presence  of  trained  evaluators  capable  of 


rendering  a  standardized  judgement.  The  NTC  Command  Group 


Evaluation  Plan  [Ref.  28]  is  reluctant  to  ascribe 


reliability  to  these  numerical  ratings,  as  indeed  they  are 


categorical  judgements  made  by  human  beings  (not  machines) 


and  hence,  subject  to  a  variance  in  accuracy. 
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However,  there  is  inherent  value  in  the  judgements 
of  huean  beings.  Although  one  of  the  aajor  weaknesses  of 
the  ARTEP  is  its  reliance  on  huaan  subjective  evaluation, 
this  does  not  mean  there  is  no  worth  to  such  judgements. 

Some  hold  the  opinion  that  the  lack  of  standardization  in 
training  and  scenario  leads  to  inaccuracy  in  ASTEP 
evaluations  more  than  the  internal  variance  of  huaan 
judgements  does.  If  we  assume  that  a  judges  "feelings" 
about  the  scale  value  of  an  instance  (here  the  scale  is  1  to 
10)  is  a  normally  distributed  random  variable,  then  it 
possesses  some  mean  and  variance.  This  fact  can  be 
exploited  to  follow  a  technique  for  constructing  an  interval 
scale  using  data  obtained  from  categorical  judgements. 

Fortunately,  such  a  technique  exists.  In  an 
unpublished  paper  entitled,  Qfl  Constructing  Interval  Scales 
Ssiaa  Ball  Resulting  fifii  £a£aa2£i£§l  (Naval 

Postgraduate  School,  1981)  [Ref.  30],  Professeor  Glenn  F. 
Lindsay  outlines  in  detail  a  method  by  which  categorical 
judgements  exactly  like  the  OC  1  to  10  scale  can  be 
connected  to  an  interval  scale  (see  Appendix  D) .  This 
method  can  be  used  for  any  number  of  judges,  and  is  suitable 
for  machine  computation.  The  method  as  described  [Ref. 
30:pp.  1-15]  literally  constructs  estimates  of  the  mean  and 
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variance  of  the  particular  "feelings’*  (ratings)  of  judges 
and  ultimately,  through  the  assuaption  that  these  feelings 
are  nornally  distributed,  produces  an  estiaate  of  the  HOEs 
value  on  an  interval  scale.  The  aethod  also  produces 
estiaates  of  the  upper  and  lower  bounds  for  each  category, 
i.e.  the  categories  1  to  10. 

The  end  result  of  this  aethod  is  a  particular  value 
for  this  given  HOE  (drawn  froa  the  Battalion  Coaaand 
Group/Staff  Evaluation  fora.  Figure  19)  arrayed  on  an 
interval  scale  which  shows  the  relative  interval  width  of 
each  category  (1  to  10).  These  category  widths  are 
different  for  each  HOE  as  each  HOB  is  evaluated  as  a 
separate  entity.  In  applying  this  concept  to  HOEs  evaluated 
by  OCs  at  the  HTC,  the  value  given  as  a  final  ranking  for  a 
particular  battalion  aust  be  transforaed  in  soae  Banner  to 
be  used  on  the  TSP. 

What  is  obtained  as  an  end  result  of  applying 
Lindsay's  aethod  is,  for  each  HOE  on  the  Battalion  coaaand 
Group/Staff  Evaluation  fora,  a  value  for  each  battalion  in 
the  baseline  data  located  on  an  interval  scale  of  varying 
category  width.  This  inforaation  provides  all  that  is 
necessary  for  the  TRP.  As  the  battalions  in  the  baseline 
data  set  have  been  ranked,  in  effect,  on  this  interval  scale 
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Use  the  scale  shown  below  to  rate  the  overall 
performance  of  the  Coaaand  Group  and  Staff  as  a  unit 
on  each  itea.  Determine  the  quality  of  perforaance 
based  on  your  observations  and  us$  the  scale  that 
best  fits  your  assessaent.  specific  examples  to 
support  the  ratings  should  be  recorded  on  the 
evaluation  plan,  these  comments  will  provide  input 
for  after  action  reviews  and  preparation  of  the 
"Take  Hoae  Package". 


MARGINAL  ADEQUATE  EXCELLENT 

123  4567  89  10 

Low  High  Low  High  Low  High 


1.  Develop  plan  based  on  mission. 

_ 1.1  Analyze  missions. 

1.2  Identify  critical  combat  information  and 
intelligence. 

_ 1.3  Analyze  friendly  capabilities. 

_ 1.4  Select  routes/zones  to  objective. 

1. 5  Select  battle  positions. 

1.6  Plan  and  coordinate  fire  support. 

_ 1.7  plan  for  terrain  modification  and 

breaching  operations. 

2.  Prepare  and  organize  the  battlefield. 

2. 1  Determine  critical  place  and  select  a 
course  of  action. 

_ 2.2  Select  control  measures. 

_ 2.3  Coamunicate/coordinate  plans  and  orders. 

_ 2.4  Prepare  logistical  estimates  and  plans. 

_ 2.5  Prepare  personnel  estimates  and  plans. 

3.  Intelligence  preparation  of  the  battlefield. 

_ 3.1  Gather  critical  combat  information  and 

intelligence . 

_ 3.2  Analyze  OPFOfi. 

3.3  Disseminate  critical  information  and 
intelligence. 


Pigure  19:  Battalion  Command  Group/Staff  Evaluation  Form 
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for  this  hoe,  the  proportion  o£  rankings  above  and  below  the 
value  assigned  to  the  current  training  battalion  can  be 
calculated.  This  provides  the  p-value  necessary  to 
calculate  a  T-score,  and  results  in  a  decile  evaluation  for 
the  TRP. 

The  current  Battalion  Coasand  Group/Staff  Evaluation 
fora  contains  eight  HOEs  with  each  HOE  possessing  froa  two 
to  seven  HOPS.  This  scaling  procedure  could  be  applied  to 
each  HOP  individually,  and  if  desired  an  entire  TRP  could  be 
generated  to  reflect  the  OC  evaluations.  This  saae 
procedure  applies  without  aodification  to  the  Process 
Assessaent  fora  [Ref.  29:Incl  2],  the  second  evaluation 
planned  for  the  battalion  coaaand  group/staff.  This  was 
designed  by  the  Army  Organizational  Effectiveness  Center  and 
School  (OECS)  to  evaluate  the  within-group  (Coaaand 
Group/Staff)  process  of  coping  with  aissions  and  external 
stiauli  [Ref.  28],  Obviously,  if  this  wealth  of  inforaation 
is  not  desired  the  OC  input  could  be  scaled  down  by 
calculating  TRP  values  for  only  selected  HOEs  and  including 
then  in  the  previously  outlined  TRP. 

This  aethod  aust,  cf  course,  be  used  carefully,  as 
it  is  auch  aore  subjective  by  nature  than  the  aachine 
gathered  data.  The  basic  assuaptions  of  the  Lindsay  aethod 


need  to  be  studied  in  conjunction  with  real  OC  input  data  to 
determine  questions  of  the  reliability  of  OC  input,  and 
whether  the  set  hod  is  truly  appropriate.  These  questions 
cannot  be  examined  until  real  OC-obtained  data  is  available. 
The  aethod  is  offered  here  as  a  suggestion  for  expansion 
along  a  path  that  could  prove  to  be  very  profitable  for  the 
Aray.  It  is  net  inconceivable  that  sost  battalion 
perforaance  aay  be  highly  correlated  to  battalion  coaaand 
group  processes.  Thus,  investigation  with  the  TBP  could 
yield  the  real  key  to  deteraining  how  best  to  train 
battalions  in  a  cost  effective  aanner.  It  aay  be  possible 
to  deteraine  the  eapirical  relationship  between  coaaand 
group  perforaance  and  unit  proficiency.  If  this  occurs, 
real  cost  effectiveness  in  training  could  be  achieved,  as  it 
is  certainly  cheaper  to  train  a  group  of  several  officers 
than  a  unit  of  several  hundred  soldiers. 

3.  ttBiaaiga  Qf-jx&laatiaiLjaBateilili 

Certainly  the  aost  fruitful  areas  of  expansion  for 
the  TRP  lie  in  the  direction  of  those  EEAs  identified  as 
iaportant  in  the  top-down  anlysis,  but  not  yet  incorporated 
into  the  NTC  instruaented  environaent.  The  coabat  service 
support  (CSS),  nuclear,  biological,  and  cheaical  (NBC), 
coaaand,  control,  and  coaaunication  (C3)  and  intelligence/ 
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counter  intelligence  EEAs  are  important  on  the  battlefield. 
Any  increased  reporting  procedures  which  can  help  to 
properly  evaluate  these  functions  will  ultimately  improve 
the  overall  evaluation  of  a  unit.  These  functional  areas 
need  to  be  further  analyzed  so  that  the  processes  involved 
in  these  areas  can  be  identified.  Once  the  processes  are 
enumerated,  quantifiable  HOEs  can  be  defined  for  the  basis 
of  an  evaluation. 

The  first  area,  CSS,  is  aost  amenable  to  further 
instrumentation  and  should  be  equipped  at  the  earliest 
possible  time.  If  CSS  vehicles  could  be  instrumented  to 
reflect  even  just  position,  a  wealth  of  CSS  data  could  be 
obtained.  Instrumenting  fuel  tanker  vehicles  to  reflect 
flow  rates,  and  supply  vehicles  to  indicate  type  of  load, 
i.e.  ammunition,  food,  etc.,  could  greatly  improve  CSS 
measurement.  These  improvements  would  allow  the 
determination  of  SOBs  directly  related  to  CSS  evaluation  and 
thus  this  topic  could  be  included  in  the  TEP. 

HBC  evaluation  will,  for  the  forseeable  future,  be 
relatively  uninstrumentable.  OC  input  could  be  used  to 
assess  NBC  casualties  if  real  gas  (non-lethal  training 
agents)  were  employed  against  training  units.  Such  casualty 
assessments  could  be  reflected  in  the  mission  accomplishment 
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portion  of  the  TRP  as  an  adjunct  to  percent  friendly 
personnel  survived  (PPPS)  and  plotted  on  the  TRP  adjacent  to 
PPPS  in  a  fashion  siailar  to  the  eultiple  weapons  HOEs. 

This  crude  assessment  would  be  flawed,  however,  since  many 
casualties  would  undoubtedly  escape  controller  detection, 
but  would  at  least  provide  a  rough  determination  of  NBC 
defensive  capability. 

C3  and  intelligence/counter  intelligence  remain  as 
two  areas  difficult  to  evaluate.  Little  can  be  done  at  the 
moment  to  instrument  such  evaluations  since  these  are 
primarily  "people"  assessments.  The  OC  nay  already  possess 
an  effective  tool  for  evaluating  these  areas.  The  Battalion 
Command  Group/Staff  Evaluation  form  contains  some  C3  and 
intelligence  considerations.  These  could  be  expanded  by 
defining  additional  HOEs  [ aef .  29],  Using  the  technique 
outlined  in  section  2  above,  it  could  be  possible  to 
assemble  TRP  pages  containing  evaluations  for  these  areas. 
Thi3  subjective  evaluation  is  at  the  mercy  of  the 
limitations  pointed  out  previously,  but  at  least  it  offers  a 
"rough  cut"  at  determining  a  true  evaluation  of  their 
contribution  to  unit  performance.  Thus,  C3  and  intelligence 
HOBs  could  be  reflected  as  appropriate  on  the  TRP. 
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These  suggested  expansions  of  the  NTC  capability  are 
by  no  aeans  complete,  competent  analysis  of  HTC  operations 
after  the  instrumented  battlefield  is  fully  operational  will 
no  doubt  reveal  other  aethods  for  evaluation.  These 
suggestions  offer  a  beginning,  however,  based  on  the  TRP 
methodology.  The  rapid  and  coaplete  dissemination  of 
evaluation  results  to  the  training  unit  can  only  increase 
training  proficiency  and  aid  the  coaaander  in  allocating 
liaited  training  resources. 

C.  STATISTICAL  ANALYSIS 

The  NTC  exists  to  train  the  heavy  battalion  task  forces, 

and  entertains  other  functions  only  when  they  do  not 

interfere  with  unit  training.  This  is  absolutely  correct  as 

a  policy.  However,  the  wealth  of  data  gathered  at  the  NTC 

cannot  be  allowed  to  lie  fallow.  The  establishing  authority 

recognizes  this  fact,  and  states  that: 

"A  trend  analysis  of  data  will  be  useful  in  assessing 
current  doctrine  and  tactics  and  evaluating  training 
development  efforts. .. Testing  of  new  concepts,  equipment, 
or  systems  will  be  permitted  at  the  NTC  when  it  does  not 
interfere  with  the  training  or  the  training  environment." 
f  fief.  13:pg.  2] 

A  great  deal  can  be  accomplished  with  the  NTC  data  in 
its  present  format,  but  even  aore  can  be  done  with  the 
instrumented  data  if  it  is  drawn  from  the  TBP  structure. 
There  is  much  that  can  be  learned  about  the  combat  process 
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in  this  aacaer.  Only  a  few  siaple  statistical  analysis 
techniques  are  needed  to  begin  reaping  regards  froa  this 
available  data.  &  basic  approach  is  suggested  here.  This 
is  by  no  aeans  an  all-inclusive  listing  of  available 
statistical  procedures,  and  should  be  viewed  as  aerely  a 
starting  point  for  analysis  purposes.  Certainly  the  shape 
and  fora  of  real  HTC  data,  once  it  is  obtained,  will 
deteraine  the  appropriate  statistical  inference  techniques. 

1-  The..?,  Statistic 

One  of  the  aost  useful  statistics  in  probability 
theory  is  X,  tSe  average  of  a  data  saaple.  If  we  regard  the 
HOG  as  a  randoa  variable,  then  at  any  given  aoaent  the 
baseline  data  set  contains  63  historical  saaple  points  for  a 
given  HOE.  The  Central  Liait  Theorea  [fief.  31:pp.  255-260] 
then  allows  one  to  use  X  as  an  estiaate  of  the  population 
aean,  p  ,  as  long  as  we  are  sampling  froa  a  noraal 
population.  This  presents  a  minor  difficulty,  as  the 
assumption  that  the  HOE  distributions  are  noraal  has  not 
been  made  explicitly  so  far.  This  situation  will  require 
the  judgement  of  a  competent  analyst.  Before  performing  any 
operations  on  T,  the  data  set  must  be  transformed  to  noraal 
(if  not  already  noraal).  Having  done  this,  a  nuaber  of 
operations  can  be  perforaed  with  x. 
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Since  SC  is  the  lean  of  a  random  sample  of  size  a-6 3, 
drawn  from  a  noraal  population  with  aean  =  n  and  variance  =  crz 
its  (X's)  saapling  distribution  is  also  noraal  with  aean  »  n 
and  variance  ffVn.  It  can  be  deaonst rated  that  for  the 
noraal  population,  X  is  the  aaxiaua  likelihood  estiaator  of 
the  population  aean.  Thus  X  yields  soae  concrete 
inforaation  about  the  paraaeters  of  the  baseline  data  set 
population.  This  population  is,  of  course,  the  set  of  heavy 
battalions  in  the  continental  OS  training  at  the  NTC. 

Hence,  X  reflects  the  attributes  of  the  Aray  as  a  whole. 

This  fact  can  be  useful  for  trend  analysis.  The  NTC 
will  certainly  have  a  salutary  effect  on  training  levels 
throughout  the  Aray.  A  tiae  plot  of  X,  using  the  baseline 
data  set,  should  reveal  Ar ay-wide  progress  trends  for  each 
NOE.  This  inforaation  would  be  particularly  useful  in 
assessing  the  effectiveness  of  NTC  training  over  tiae  and  in 
future  justification  of  the  NTC  operation  (budget) .  To 
ascertain  more  accurately  the  actual  significance  of  these  X 
values,  confidence  intervals  about  X  can  be  calculated  for 
given  levels  of  significance  using  standard  statistical 
practices.  [Ref.  31;  pp.  342-346  ] 

The  calculation  of  a  confidence  interval  about  x 
might  also  yield  other  useful  information,  as  it  would 
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reflect  the  ••  spread”  of  the  X  statistic  considered  to  be 
significant.  An  appraisal  of  the  width  of  that  confidence 
interval  sight  give  some  subjective  idea  about  how  precise  a 
reflection  of  training  particular  HOEs  are.  If  the 
confidence  interval  is  large,  it  aay  be  due  to  a  fund;  lental 
difficulty  in  the  MOB;  that  is,  the  HOE  aay  not  be  an 
accurate  reflection  of  the  quantity  being  aeasured. 

Hypothesis  testing  of  X  could  also  be  conducted  to 
assist  in  trend  anaysis.  Using  one-tailed  tests,  it  would 
be  possible  to  deteraine  the  direction  of  change  in  the  mean 
from  period  to  period  (quarter  to  quarter,  month  to  month, 
or  whatever  report  interval  is  desired) .  That  is,  given  a 
period  1  preceeding  a  later  period  2,  a  null  hypothesis  that 
the  mean  level  of  performance  remained  the  same  between 
periods  (m,  =  Ma  )  could  be  tested  against  an  alternate 
hypothesis  that  the  level  of  training  improved  ( h, <  P2  )  • 

If  the  statistical  test  allows  the  acceptance  of  the 
alternate  hypothesis  that  the  mean  levels  of  performance 
within  the  random  sample  have  risen,  i.e.  pa  >  p,  ,  then  it 
can  be  assumed  that  the  HOE  averages  are  rising  and  the 
level  of  combat  proficiency  in  the  Army  is  improving. 

This  is  overall  an  exciting  concept,  because  for  the 
first  time  Army  training  progress  could  become  verifiable. 
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and  the  increase  in  large  unit  slcills  docuaented.  This  is 
in  no  way  possible  nov  with  the  ARTEP  systea  of  evaluation. 
The  ARTEP  systea  has  long  contributed  to  the  abuse  of 
readiness  reports  (readiness  condition  levels)  due  to  its 
subjective  nature.  Using  the  TRP,  it  aay  now  becoae 
possible  to  accurately  reflect  Aray-wide  readiness  levels. 

As  this  aethodology  for  X  analysis  is  keyed  to  the 
baseline  data  set,  it  would  be  iapossible  for  the  aoaent  to 
deteraine  individual  unit  readiness  froa  the  NTC.  However, 
trend  anaysis  as  previously  described  aay  yield  a  linkage 
between  hoe  values  and  unit  readiness,  and  thus  readiness 
conditons  could  be  evaluated  by  the  NTC  results.  This  is 
probably  not  advisable,  however,  as  this  converts  any  NTC 
exercise  into  a  defacto  test.  Thus,  in  order  to  preserve 
the  NTC  as  a  training  ground,  any  assessaent  of  readiness 
levels  should  be  restricted  to  an  Aray-wide  basis. 

This  problem  not  withstanding,  if  desired  readiness 
goals  can  be  linked  HOE  X  values  by  judicious  analysis  (or 
by  arbitrary  decision  based  on  senior  officer  coabat 
experience) ,  a  powerful  assessaent  tool  has  been  created  for 
the  Aray  Staff.  By  observing  the  trends  and  viewing  the 
progress  of  the  Aray  as  reflected  in  the  baseline  data  set, 
the  Chief  of  staff  and  other  senior  Aray  leaders  could  gain 
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a  much  aore  concrete  and  reliable  assessment  of  Army 
capab* lities.  This  path  holds  auch  proaise  for  future 
analysis. 

2.  iz5SQ£fl-AaaiigjLg 

The  T-score  has  been  utilized  in  the  TBP  as  a 
vehicle  for  reflecting  equal  intervals  of  ability.  This 
system  is  not  critical  in  providing  the  coaaander  with  a 
normative  evaluation.  Siaple  deciles,  calculated  froa  the 
raw  data  could  suffice  for  that  purpose.1*  The  T-score, 
however,  provides  a  major  benefit  in  the  analysis  of  the 
resulting  data.  The  aost  powerful  of  all  statistical  tests 
are  the  parametric  tests.  These  tests  often  require  the 
assumption  of  normality,  that  is,  that  the  samples  be  drawn 
from  a  normal  population.  The  T-score  conversion 
automatically  transforms  all  data  distributions  to  a  normal 
(50,10)  distribution.  This  allows  the  application  of  aost 
parametric  tests,  as  all  samples  can  now  be  considered  to  be 
drawn  froa  a  normal  distribution.  Additional  convenience  is 
afforded  by  the  fact  that  the  standard  deviation  is 
transformed  to  a  fixed  value  (10)  for  all  MOEs  and  this 
allows  several  powerful  coaparison  tests  to  be  used. 

19This  assumes  that  the  problems  addressed  in  Chapter  4 
do  not  occur,  i.e.  sparseness  of  data  and  synergistic  "test 
problem"  effects.  See  Chapter  4,  section  A (4) . 
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Thus,  parametric  tests  concerning  means  can  be 
employed  to  conduct  trend  analysis  [Ref.  31: pp.  390-396]. 

The  effect  of  NTC  training  can  thus  be  verified  by  the 
hypothesis  testing  of  HOE  means  to  see  if  they  are 
increasing  (at  an  appropriate  significance  level) .  The 
differences  between  HOE  means  can  also  be  tested  to  see  if 
some  particular  combat  skills,  as  measured  by  the  HOE,  are 
being  learned  better  than  others.  The  application  of  these 
tests  to  TRP  data  (T-scores)  can  pay  big  dividends  in 
increased  understanding  of  the  combat  process,  which  is 
beneficial  to  combat  development  agencies,  and  better 
understanding  of  the  effects  of  the  HTC  training  on  unit 
performance. 

One  of  the  biggest  advantages  of  the  use  of  t- 
scores,  however,  is  in  regression  and  correlation  analysis. 
&s  all  HOEs  are  distributed  identically  after  undergoing  the 
T-score  transformation,  the  techniques  of  multiple 
regression  analysis  can  be  utilized  to  examine  the 
interrelationship  of  the  HOEs.  This  analysis  could  not  only 
include  correlation  analysis  to  determine  HOE 
interrelationships,  but  also  could  examine  the  combat 
process  in  detail. 
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Multiple  regression  could  be  used  to  link  HOE 
performance  to  cosbat  mission  outcome.  In  order  to  do  this, 
define  mission  accomplishment  as  a  function  that  is 
determined  by  the  values  of  the  HOE  T-scores.  The 
particular  model  represented  by  the  data,  i.e.  linear, 
guadratic,  etc.,  could  be  investigated  to  determine  the  true 
relationship  of  various  HOEs  to  mission  accomplishment. 

Thus,  by  using  standard  regression  techniques  on  the 
NTC  data  base  over  a  sufficient  period  of  time,  it  would  be 
possible  in  theory  to  determine  for  the  first  time  the 
empirical  relationship  of  HOEs  (or  skills)  to  mission 
outcome.  This  sort  of  study  is  absolutely  impossible  under 
the  current  A STEP  system  for  reasons  outlined  in  Chapter  1. 
This  analysis  is  normally  only  done  by  combat  developments 
agencies  at  great  expense.  It  could  now  be  done  at  no 
additional  expense  to  the  Army  on  a  routine  basis.  This 
analytic  effort  would  ifi  qo  way  affect  the  training  unit  or 
interfere  with  its  operations.  Using  the  TBP  as  a  medium  it 
allows  for  analysis  of  the  combat  process  to  a  degree  never 
before  attainable,  and  could  conceivably  greatly  affect 
future  Army  operations  and  training. 

Other  techniques,  of  course,  also  have  much  to 
offer.  To  investigate  sets  of  HOEs  to  determine 
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relationships  chi-square  contingency  tables  could  be 
eaployed.  Two  HOEs  could  be  contrasted  by  appropriately 
subdividing  the  TRP  T-scores  into  categories  and  casting  a 
selection  of  data  froa  the  baseline  set  into  contingency 
tables.  These  tables  could  be  tested  for  significance  and 
thereby,  HOE  relationships  exaained  for  their  contribution 
to  the  mission  outcoae.  As  an  exaaple  of  this,  "percent 
planning  tine  forwarded"  (PPTF)  could  be  contrasted  with 
"percent  friendly  personnel  survived"  (PFPS)  to  see,  if 
indeed,  "haste  aakes  waste".  Many  other  such  analyses  are 
possible . 

Standard  analysis  of  variance  (ANOVA)  techniques  can 
be  applied  to  the  T-scores  to  wring  even  aore  inforaation 
out  of  then.  There  is  no  liait  to  the  interactions  and 
relationships  that  can  be  investigated  between  the  various 
HOEs.  The  T-score  does  not  hold  such  to  offer  the  unit 
conaander  directly,  but  it  contains  a  wealth  of  data  for  the 
analyst.  Yet  for  all  of  its  usefulness,  the  T-score  is 
obtained  alaost  painlessly  through  the  TRP  structure, 
without  the  TRP,  auch  useful  data  is  absolutely  wasted.  By 
eaployinq  the  TRP,  a  whole  universe  of  coabat  developaents 
and  operational  analysis  will  be  aade  available  for  the 
Arny. 
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3 .  Nonparaaetric  Analysis 

Earlier  in  this  chapter  a  method  was  described  by 
which  the  OC  inputs  of  a  subjective  nature  could  be  scaled 
into  a  "harder"  number  and  employed  in  a  THP .  This  system 
is  workable  and  allows  an  otherwise  "fuzzy"  rating  scheme  to 
be  included  in  the  TRP.  The  OC  rating  in  itself,  however, 
possesses  a  great  deal  of  usefulness  in  its  present  fora. 

The  behavioral  sciences  have  long  drawn  conclusions  from 
data  which  is  just  as  subjective.  This  has  been 
accomplished  through  the  use  of  nonparaaetric  statistical 
analysis  which  is  essentially  "distribution  free"  and  often 
not  encumbered  by  the  necessary  assuaption  of  normality  as 
the  parametric  tests  require.  Such  statistics  are  just  as 
fitting  in  this  instance,  for  the  OC  is,  in  essence,  doing 
what  many  clinical  psychologists  do  in  the  course  of  an 
experiment:  he  is  evaluating  human  interaction  and 
perforaance. 

The  scaling  methods  of  Lindsay  [ Ref.  30]  provide  oc 
data  on  an  interval  scale.  The  interval  scale  is 
sufficiently  well-defined  to  permit  the  application  of 
standard  parametric  tests  in  the  analysis  of  data  [Ref. 
27:pg.  62].  This  aay  not,  however,  be  desirable  or  feasible 
once  actual  data  is  obtained.  An  in-depth  analysis  of 
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actual  OC  evaluations  would  be  necessary  before  statistical 
inference  techniques  could  be  applied.  At  the  tine  of  this 
writing,  the  MTC  inst rusentation  has  been  installed  only  one 
■onth.  Therefore,  it  is  inpossible  to  find  the  actual 
distribution  and  reliability  of  OC  input  data.  Hence,  if  it 
is  felt  that  paranetric  tests  are  not  suitable  for  this 
transforaed  data,  nonparaaetric  alternatives  are  available. 

This  suggested  prograa  is  aostly  directed  toward 
deternining  training  progress.  That  is,  these  nonparaaetric 
tests  would  be  most  useful  in  deternining  if  progress  has 
occurred.  Two  tests  are  suggested  as  a  basic  beginning,  and 
the  applicability  of  other  nonparaaetric  tests  is  limited 
only  by  the  skill  of  the  analyst. 

In  turning  to  nonparaaetric  test  theory,  it  is 
assuaed  that  the  battalion  conaand  group/staff  evaluation  is 
unchanged  from  aission  to  mission.  That  is,  the  functioning 
of  the  commander  and  staff  is  assuaed  to  be  a  constant 
process  no  matter  what  operation  is  being  conducted.  Each 
aission  might  require  some  different  specific  task  to  be 
performed  by  the  unit,  but  the  functioning  of  the  staff 
element  will  fellow  the  same  basic  procedures.  If  this  is 
the  case,  then  differences  in  the  OC  evaluation  from  the 
first  aission  evaluated  to  the  last  aission  evaluated  will 
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reflect  the  aaount  of  learning  or  increase  in  training 
proficiency  attained  by  the  coasand/staf f  eleaent. 

In  order  to  assess  this,  several  nonparaaetric  tests 
for  two  related  saaples  (i.  e.  the  battalion  coaaand 
group/staff  perforaance  at  two  different  tiaes)  can  be 
eaployed.  The  NcHeaar  test  for  the  significance  of  changes 
[Ref.  27:pp.  63-67]  can  be  used  for  this  purpose.  In  this 
test  each  person  or  itea  (here,  the  battalion  coaaand 
group/staff)  serves  as  its  own  control.  The  test  would  take 
the  first  evaluation  and  coapare  it  to  a  later,  subsequent 
evaluation.  In  this  Banner  an  increased  level  of  training 
would  be  shown  if  the  difference  in  the  evaluation  ratings 
received  was  deeaed  significant  at  the  chosen  level. 

An  even  aore  powerful  test  to  use  in  this  situation 
would  be  the  Rilcoxon  Batched- pairs  signed-ranks  test.  This 
test  alaost  requires  an  interval  scale,  but  not  quite. The 
test  fully  uses  all  the  inforaation  available  in  the  data. 

It  is  ideally  suited  to  deteraining  the  bef ore-and-after 
effect  of  events,  and  could  accurately  reflect  the 
iaproveaent  in  the  battalion  coaaand  group/staff  operations 
due  to  training  at  the  HTC.  This  test  could  be  eaployed  by 

2°See  Siegel  [Ref.  27: pg .  76]  for  a  coaplete  explanation 
of  test  requireaents.  Siegel  discusses  an  "ordered  aetric" 
scale,  which  falls  between  the  ordinal  and  interval  scale. 
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using  the  thirty  OC  evaluation  SOEs  as  sample  it ess,  and  the 
values  of  the  MOEs  for  the  first  and  subsequent  (or  last) 
evaluations  as  the  before-and-after  conditions.  For  a 
detailed  discussion  of  the  actual  technique,  see  Siegel 
[Ref.  27:pp.  75-83] 

Of  course,  aany  other  nonparaaetric  tests  could  be 
applied  to  the  NTC  data,  both  instrunented  and  oc-input. 

Such  analysis  would  not  only  reflect  the  value  of  NTC 
training,  but  also  help  to  justify  future  expansion  through 
sore  incisive  cost  effectiveness  analyses.  Monparametric 
anova  can  also  be  used  to  exaaine  the  relationships  of 
either  OC  SOEs  or  instrumented  SOEs  by  determining 
interactions.  It  might  even  be  possible,  in  future 
training,  to  structure  data  for  fractional  factorial 
analysis  and  thus  begin  an  in-depth  look  at  the  interactions 
of  the  complex  combat  processes.  This  information  could 
prove  to  be  extremely  valuable  to  combat  developments 
activities  by  helping  to  clarify  the  key  interactions  of 
unit  skills  on  the  battlefield. 

The  NTC  is  not  a  test  bed,  but  rather  an  instrument 
for  accomplishing  realistic  training.  Several  statistical 
methods  have  been  presented  here  using  the  TRP  structure  as 
a  basis.  It  should  be  noted  that  these  methods  require  no 


interference  with  the  training  unit,  and  all  analysis  can  be 
done  any  tine  after  the  completion  of  an  exercise.  This 
systea,  utilizing  the  IBP  as  its  heart,  allows  for  exciting, 
significant  analysis  of  all  data  without  increasing  the 
requirement  for  additional  controllers. 

The  point  to  be  noted  here  is  that  the  TBP  serves  as 
a  vehicle  for  this  analysis,  in  addition  to  its  already 
meaningful  role  as  a  training  evaluation  and  resource 
allocation  aid.  Thus,  the  TRP  has  been  shown  to  be  a  useful 
device  not  only  to  assist  in  training  evaluations,  but  for 
combat  developments.  Army  trend  analysis  and  even  future 
budget  justification.  It  is,  indeed,  a  versatile 
methodology. 
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VI.  CONCIOSIOHS  AND. RECOMMENDATIONS 

The  Nation,  and  the  Any,  have  expended  a  great  deal  of 
effort,  tiae,  and  aoney  in  establishing  the  National 
Training  Center.  The  realistic  training  environaent  at  the 
NTC  could  serve  to  greatly  increase  the  Aray's  coabat 
readiness  and  iaprove  the  chances  of  survivability  in  any 
future  conflict.  Before  these  benefits  can  be  realized, 
however,  the  NTC  aust  produce  a  valid  and  thorough 
evaluation  of  unit  training  perforaance.  It  is  these 
evaluations — evaluations  of  training  standards  for  large 
units--that  assist  coaaanders  in  identifying  unit  training 
weaknesses.  Resources  can  be  allocated  to  training 
weaknesses  and  reaedial  training  accoaplished  only  after  all 
shortcoaings  are  clearly  identified.  The  desired  result, 
therefore,  is  to  gain  the  aaxiaua  benefit  froa  liaited 
training  resources  and  produce  an  Aray  that  perforas  at  a 
high  level  of  coabat  proficieucy. 

An  atteapt  has  been  aade  here  to  exaaine  the  current 
Aray  training  systea  froa  its  inception  to  its  application 
at  the  National  Training  Center.  This  exaaination  has 
focused  on  the  area  whir:,  presents  today's  training  aanager 
with  the  lost  dif ficulty~the  evaluation  (and  indirectly  the 
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establishment)  of  training  standards  for  large  units.  This 
is  a  problea  of  great  difficulty,  and  has  not  been  properly 
addressed  in  recent  tines. 

The  creation  of  the  NTC  has  spurred  efforts  in  this 
field,  and  has  resulted  in  an  alaost  revolutionary 
breakthrough  in  the  training  process.  The  instrunentsd 
battlefield  will  present,  for  the  first  tiae  in  Aray 
history,  a  realistic  training  ground  where  the  synergistic 
effect  of  aodern  kray  weapons  can  truly  be  evaluated.  It 
will,  indeed,  provide  unit  coaaanders  with  a  statistically 
reliable,  objective  training  evaluation.  Traditional  ABTEP 
feedback  processes  and  AAR's  as  planned  for  the  NTC  do  not 
fully  capitalize  on  this  fact. 

A.  CONCLUSIONS 

The  Training  Readiness  Profile  atteapts  to  capitalize  on 
the  statistically  reliable  data  gathered  by  the  NTC.  The 
NTC  is  a  revolutionary,  not  evolutionary,  step  forward.  As 
befits  such  a  systea,  the  TRP  is  proposed  as  a  aethodology 
for  use  there.  The  TRP  eaploys  a  method  previously  unused 
in  Aray  training  prograas.  It  is  believed  that  this  unique 
aethodology  addresses  a  nuaber  of  current  training  probleas 
fully — and  takes  aaxiaua  advantage  of  the  NTC's  objective, 
statistically  reliable  data.  The  TRP  will  allow  the  NTC  to 
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realize  its  full  potential,  and  recognizes  that  the  quality 
of  evaluation  provided  to  the  training  unit  is  of  he; 
importance. 


The  TRP,  by  virtue  of  its  structure,  accrues  the 
following  benefits  through  its  use: 


•  It  provides  a  simple,  reliable,  easy-to-understand  unit 
training  evaluation.  It  eliminates  "telephone  booh" 
sized  ARTEP  evaluations  and  dreary  statistics. 


■  It  provides  an  almost  wholly  objective  (machine  driven) 
training  evaluation,  without  possible  human  subjective 
bias  or  prejudice. 


«  It  alleviates  the  problem  of  determining  large  unit 
subtask  standards  (a  prodigious  effort  in  itself)  by 
utilizing  a  normative  evaluation. 

•  It  allows  meaningful  evaluation  without  resorting  to 
grades,  and  does  50  in  almost  cheat-proof  way--by 
evaluating  an  entire  unit  at  once. 

■  It  assists  commanders,  both  HTC  and  unit,  in  setting 
standards  for  scenarios  by  clarifying  issues  of 
performance. 


•  It  literally  provides  defacto  standards,  and  easily 
allows  for  judgmental  standards  to  be  inserted. 


■  It  facilitates  Army-wide  training  level  standardization 
by  illuminating  "Army  performance"  through  the  baseline 
data  set,  ana  communicates  this  "peer  performance"  to 
the  unit  commander.  Thus,  it  tells  him  what  other 
battalions  are  capable  of. 


•  It  illustrates  complementary  weaknesses  in  training  and 
can  help  tc  highlight  the  interactive  effect  of  training 
deficiencies  in  combat. 


•  It  provides  to  the  unit  commander  a  solid  guide  for 
allocating  training  resources,  by  defining  (through 
normative  evaluation)  the  worst  areas  of  unit 
performance — those  that  need  more  training. 


■  It  does  not  usurp  command  authority  and,  indeed,  still 
requires  the  commander  to  make  allocation  decisions  and 
examine  his  unit's  training  status  in  detail. 


■  It  holds  great  potential  for  combat  developments 

analysis  "as  is"  without  extensive  data  modification  or 
additional  data  collection. 


■  It  can  be  used  as  a  tool  for  assessing  Army-wide 
readiness  by  clearly  portraying  training  trends  and 
levels  of  capability. 


■  It  has  a  great  deal  of  flexibility  inherent  in  the 
system  and  possesses  unlimited  potential  for  expansion 
and  further  application  m  several  fields. 


■  It  allows  the  National  Training  Center  to  realize  its 
full  potential  by  not  only  organizing  data  for  unit 

Sfesentation  and  use  but  also  by  allowing  combat 
evelopments  work  to  proceed  apace  simultaneously  with 
training,  without  mutual  interference. 


These  extensive  and  valuable  benefits  are  available  simply 


by  implementing  the  Training  aeadiness  Profile  at  the  NTC . 


In  the  preceeding  chapters  two  forms  of  evaluation  have 


been  discussed;  the  subjective  standard  evaluation  and  the 


objective,  normative  or  relative  performance  evaluation. 


Analytically,  the  normative  evaluation  works  best  at  the 
present  time.  Start-up  problems  inherent  in  any  complex 
operation  such  as  the  NTC  will  render  arbitrarily  fixed 


standards  irrelevant  in  short  order  if  they  are  not  based  on 


a  normative  assessment  of  what  is  really  happening  on  the 
instrumented  training  area.  Long  term  analysis  will  be 
necessary  to  effect  the  formulation  of  such  fixed  standards 
[8ef.  14:pp.  III-9  to  HI-11].  The  NTC  neither  has  this 


analytic  capability  at  present,  nor  is  it  likely  to  acquire 
any  in  the  near  future  as  trained  operations  research 
analysts  (specialty  code  49)  are  not  planned  or  projected 
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for  assignment  to  the  HTC  in  quantity,  in  in-dep-th  analysis 
of  NTC  operations  will  be  necessary  to  assess  realistic 
scenario  standards,  and  in  the  interia  (or  even  permanently) 
the  normative  evaluation  process  is  perfectly  acceptable. 
Both  normative  and  fixed  standard  evaluations  may  prove 
useful  in  the  long  run  with  neither  supplanting  the  other. 


B.  RECOMMEND AT IONS 

The  following  recommendations  are  made  for  improving  the 
operation  of  the  National  Training  Center. 


1. 


To  assist  commanders  in  identifying  training 
weaknesses  the  TBP  concept  should  be  implemented  at  the  NTC. 
The  TRP  should  be  used  by  the  commander  with  the  assistance 
of  the  training  analysis  and  feedback  (T&F)  personnel  for 
directing  efforts  to  determine  specific  training  weaknesses. 
The  relative  comparison  between  HOEs  should  be  used  when 
prioritizing  the  allocation  of  training  resources.  The 
implementation  of  the  TBP  should  be  a  matter  of  high 
priority  to  insure  that  the  maximum  training  benefits  (as 
outlined  above)  are  availible  to  all  units  training  at  the 
NTC  as  soon  as  possible. 
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Currently,  there  are  no  operations  research  analyses 


assigned  to  the  NTC  section  at  Ft.  aonroe,  the  agency 
responsible  for  the  continuing  development  of  the  NTC.  To 
provide  assistance  in  the  design  and  growth  during  the 
expansion  phases  of  the  HTC  an  operations  analysis  cell 
should  be  assigned  to  the  TBADCC  Systems  Manager  (TSB) 
office  at  Ft.  aonroe.  The  analysis  cell  or  group  would 
provide  the  capability  to  structure  and  orient  the 
instruaentation  equipaent  package  so  as  to  aaxiaize  the 
benefits  of  producing  unit  training  evaluations. 


A  group  of  qualified  analysts  should  be  assigned  to 
the  NTC  to  assist  with  the  process  of  sorting  and  organ:"/. 
data  obtained  froa  the  instruaented  battlefield  at  the  NTC. 
Much  of  the  current  analysis  applicable  to  the  NTC  has  been 
accoaplished  by  operations  research  analysts  assigned  to 
other  organizations.  This  has  increased  the  workloads  of 
these  "parent"  organizations  (such  as  CATBADA)  while 
introducing  alaost  insurmountable  probleas  of  distance  and 
tiae  into  all  analysis  produced.  These  personnel  could  also 
conduct  the  independent  trend  analysis  necessary  to  revise 
the  base  of  HOEs  and  recoaaend  the  updating  of  standards. 


Additionally,  the  data  base  at  the  NTC  will  prove  to  be  a 
valuable  source  o£  information  for  aany  Aray  agencies.  Mhen 
this  data  is  aade  available  to  these  organizations,  chances 
are  very  great  that  they  will  want  access  to  the  data  base 
and  request  assistance  in  retrieving  selected  sections  of 
the  data.  Operations  research  analysts  present  at  the 
source  of  this  data  could  prove  to  be  a  very  cost  effective 
investment  for  the  Army,  as  it  would  increase  the  chances  of 
requestors  obtaining  the  right  data  the  first  time  it  is 
requested,  and  it  would  insure  that  researchers  understand 
the  sources  and  limitations  of  all  such  information.  In 
this  way,  coordination  between  the  NTC  and  combat 
developments  agencies  would  be  of  a  high  order. 

The  TRP  program  needs  acceptance.  There  is  no 
avoiding  the  hard  fact  that  realistic  combat  training 
evaluation  is  absolutely  necessary  if  the  Army  is  to  fight 
and  win  the  next  war.  The  TRP  is  suggested  with  the  goal  of 
attempting  to  assist  the  professional  unit  commander  in 
improving  his  unit  training.  It  does  NOT  compare  units,  but 
rather  helps  the  unit  commander  see  "how  far  he  has  to  go'1. 
It  must  be  utilized  for  what  it  is  worth,  and  accepted  in 
the  spirit  in  which  it  was  meant:  as  an  objective  training 
evaluation. 
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The  implementation  of  these  recommendations  will 
enhance  not  only  the  quality  of  training  at  the  national 
Training  Center  (through  better  feedback),  but  insure  that 
the  instruaented  data  gleaned  by  this  system  is  most 
effectively  utilized.  In  war,  a  soldier's  duty  is  clear, 
and  the  tasks  he  must  undertake  are  before  him.  In  peace, 
the  soldier  can  only  train  for  war  as  he  thinks  it  will  be. 
The  realism  of  that  training  in  peacetime  is  the  key  to  the 
soldier's  success  in  wartime.  The  ultimate  in  training 
realism  is  now  before  the  OS  Army  at  the  NTC.  There  is  no 
other  facility  like  it  at  this  time,  in  the  world.  It  must 
be  employed  in  such  a  way  as  to  assure  the  maximum  benefit 
possible  to  our  troops  that  train  there.  To  do  otherwise, 
wastes  the  resources  of  the  Nation. 

And  costs  the  lives  of  her  soldiers. 
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LIST  Of  TRAINING  MISSIONS  PLANNED  FOR  THE  NT C 

The  following  is  a  list  of  tactical  aissions  planned  for 

training  units  at  the  National  Training  Center.  These 

aissions  fall  into  two  categories:  those  aissions  considered 

to  be  so  important  that  all  training  units  will  execute  then 

while  at  the  NTC,  and  those  other  aissions  which  the  unit 

coaaander  can  choose  to  execute  or  not  according  to  his 

unit's  training  plan.  Missions  identified  by  an  asterisk 

are  considered  to  be  aost  iaportant. 

Moveaent  to  Contact  * 

Hasty  Attack  ♦ 

Deliberate  Attack  * 

Defend  in  Sector  * 

Defend  fron  a  Battle  Area  * 

Hasty  Defense  * 

Delay  in  Sector  * 

Disengageaent  * 

Counterattack  * 

Defend  a  Battle  Position  * 

Deliberate  Defense 
Reconnaissance  and  Security 
Create  and  Defend  a  Strongpoint 

A  series  of  scenarios  of  varying  intensity  will  support  each 

of  these  aissions.  These  packages  will  be  u^ad  by  the  NTC 
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Operations  Group  to  conduct  training  and  provide  orders 


training  units  in  a  rapid  and  standardized  aanner. 
18: pp.  1-12  to  1-13] 
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PROCSDORE 


The  following  definitions  were  utilized  in  accomplishing 


the  top-down  subtask  analysis  for  the  National  Training 
Center  and  are  taken  from  Reference  14,  page  IZI-5  and 


III-6. 


1.  Missions.  &  clear,  concise  stateaent  of  the  overall 
purposes  of  a  system. 

2.  Tasks,  (also  comprised  of  any  number  of  subtasks)  . 
Objectives  which  must  be  accomplished  to  satisfy  the 
mission. 


3.  EEAs.  Essential  Elements  of  Analysis.  These  are 
subcategories  of  the  tasks  which  lend  themselves  to 
analysis.  The  EEA's  should  be  derived  from  these  tasks  to 
cover  all  the  significant  aspects  of  the  force  unit's 
mission.  Thus  each  EE A  must  relate  to  one  or  more  tasks. 


4.  MOEs.  Measures  of  Effectiveness.  Quantitative 
indicators  of  the  general  ability  of  a  military  force  to 
accomplish  an  assigned  task  or  mission  under  a  specified 
set  of  conditions  (must  address  EEAs) . 


S.  MOPs.  Measures  of  Performance.  Quantitative  measures 
of  the  ability  of  a  particular  subunit  or  weapon  system  to 
accomplish  a  particular  task.  MOPs  may  be  combined  to 
compute  MOEs  or  may  address  one  or  more  EEA  directly. 


6.  Data.  Pacts  or  statistics  that  provide  descriptive 
information  pertaining  to  a  single  event. 
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APPEHDII  C 

Siummi  Ifli  cgflBAX  esa££Bl:  XU  X2£z£011  ANAL  IS  IS 

The  first  step  taken  in  the  sequence  of  events  was  the 
identification  of  EEAs.  Drawing  froa  AfiTEP  71-2  [Ref.  6], 
and  FM  71-2  [Ref.  16],  a  basic  list  of  coabat  aissions  was 
established,  listing  in  order  of  iaportance  the  coabat 
aissions  which  could  be  assigned  to  the  heavy  task  force 
[Ref.  32:Incl  2].  This  prioritized  list  was  then  sent  to 
the  TRADOC  schools  to  allow  then  to  begin  considering  HOEs 
and  MOPs  to  be  utilized  in  evaluating  unit  training  at  the 
NTC.  The  recoaaended  methodology  used  in  this  process  was 
identical  to  what  has  already  been  described,  and  reflected 
the  hierarchy  of  Figure  8  [Ref.  32:Incl  3]. 

Determining  the  EEA  did  not  prove  to  be  an  easy  task. 

The  Initial  HTC  Developaent  Plan  gave  the  responsibility  for 
the  top-down  analysis  of  coabat  tasks  to  the  TRADOC  coabat 
developaent  community  [Ref.  14:pg.  III-5 J.  This  task 
devolved  upon  the  Combined  Arms  Training  Developaent 
Activity  (CATRADA)  at  Ft.  Leavenworth,  who  began  analysis  on 
the  EEA/MOZ/MOP  structure.  The  final  EEAs  were  drawn  froa 
their  logical  source:  Aray  doctrine  as  specified  for  the 
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heavy  task  force  in  PH  71-2,  Ifre  UaJs  and  Mechanized 

Infantry  Battalion  lasJs  £2££S  CB«f-  “*63*  la  specifying  how 

to  organize  and  operate  a  heavy  task  force,  PH  71-2  utilized 

a  systea  approach,  and  defined  the  coaaander's  operating 

systeas  as: 

Maneuver 

Intelligence 

Air  Defense  Artillery 

Mobility-Counter  Mobility 

Coabat  Service  Support 

Fire  Support  [Ref.  16: pg.  3-11] 

To  this  was  added  the  coaaander's  interface  systea  of  C5-- 

Coaaand,  Control,  and  Coaaunications.  These  7  systeas 

becaae  the  BRA  for  the  MTC,  to  which  an  eighth  systea,  NBC , 

was  later  added.  This  analysis,  taken  directly  froa  current 

Aray  doctrine,  foraed  the  basis  froa  which  the  MOE/MOP 

developaent  proceeded. 

In  the  long  run  these  EEA  aust  be  considered  the  best 

choice.  The  initial  list  of  EEA  proposed  bore  little 

reseablance  to  the  hierarchy  specified  by  Pigure  8.  Those 

topics  as  originally  proposed  were  overlapping,  or  in  aany 

cases  a  function  of  one  another.  Soae  proposed  EEA  were,  in 

fact,  subsets  of  one  another.  PH  71-2  states  that: 

"Although  it  is  true  that  the  actual  fighting  is  done  by 
aeabers  of  coapanies,  it  is  the  battalion  ana  its 
coaaander  on  which  the  battle  outcoae  chiefly  depends." 
[Ref.  16  :pg .  3-2] 
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This  demonstrates  that  doctrinally  the  battalion  operations, 
as  directed  by  the  battalion  commander,  are  the  heart  of  the 
combat  process.  In  fact,  the  task  force  is  the  major 
application  of  combined  arms  fighting  ability  in  warfare 
today: 

"...the  battalion  is  the  level  which  combines  the  various 
arms  tactically  on  the  terrain  and  brings  its  combined 
combat  powers  to  bear  on  the  enemy."  [ fief .  16: pg.  3-2] 

Therefore,  any  EE A  which  purport  to  interactively  provide  an 

assessment  of  mission  accomplishment  or  unit  performance 

must  center  around  the  organized  application  of  combat  power 

by  the  battalion  commander.  Indeed,  this  is  the  primary 

goal  of  the  ETC : 

"At  the  ETC  the  primary  target  of  evaluation  and 
corrective  training  will  be  the  battalion's  ability  to 
orchestrate  the  application  of  total  combat  power."  [Ref. 
14:pg.  1-5] 

Thus,  it  is  difficult  to  conceive  of  a  selection  of  EEAs 
that  would  be  meaningful  if  they  did  not  center  around  the 
battalion's  operations.  Indeed,  as  these  EE&  are  drawn 
directly  from  Army  doctrine,  any  HOE/SOP  analysis  based  upon 
them  must  inherently  contain  the  necessary  subtasks  for  a 
proper  training  evaluation.  As  these  SEA  reflect  the 
battalion's  ability  to  integrate  the  systems  at  the  disposal 
of  the  battalion  commander,  they  will  reflect  accurately 
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unit  performance  once  eission  accomplishment  (outcomes)  are 
determined,  for: 


"Tactically  skillful  coaaaaders  have  battalions  which 
optimize  their  effectiveness  and  minimize  their  . 
vulnerabilities,  ana  thus  habitually  execute  their 
aissions  successfully  with  ainiaua  losses."  [Hef.  16:pg. 


It  is  upon  this  solid  framework  that  the  &OE/HOP  structure 


is  built.  The  work  done  by  CATHADA  and  the  service  schools 
in  determining  the  quantitative  SOEs  and  HOPS  to  be  applied 
to  unit  training  is  correctly  based  on  doctrinal 


underpinnings 
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THE  POOR  TYPES  MSASOREHEflT  SCALES 


Type  of 

Seasureaent  Use  Exaaple 

Scale 


Hoainal 


Identification 


Assignaent  of 
street  nuabers. 
License  plates 


Ordinal  Ranking  without  A  is  better  than  B 

Quant it at ive 

Coaparison  B  is  better  than  C 


Interval  Ranking  on  a  Fahrenheit  and  Cen- 

Non-Absolute  tigrade  teaperature 

Scale  scales;  any  aeasu- 

reaent  scale  that  pro¬ 
vides  fixed 
intervals  for 
coaparison  but 
whose  zero  point  is 
arbitrarily  fixed. 


Ratio  Rank  Order  Based  on  an  abso 

(Cardinal)  lute  ze?o.  This 

scale  gives  order 
absolute 
differences,  and 
the  true  ratio 
between  the 
quantities 
aeasured. 


175 


hsimn  & 


IDENTIFYING  THS  HEASOBES  21  TRAINING  EiiBfOBftABCE 

In  initially  considering  the  problem  of  identifying  HOE 

for  use  at  the  NTC  the  above  philosophy  seees  innocuous 

enough,  but  it  was  soon  discovered  that  accurate  HOE  were 

difficult  to  come  by.  No  one  had  ever  dealt  with  the 

battalion  level  coabat  process  to  such  an  introspective 

degree  before,  in  tackling  the  problea  at  CATRADA,  a 

slightly  aodified  NOE  developaent  methodology  was  posited 

[Ref.  20].  The  saae  hierarchy  as  deaonstrated  in  Figure  8 

was  utilized,  but  in  the  analysis  of  the  eight  EEA  efforts 

were  focused  on  the  six  interrogatives: 

"The  three  categories  (EEA's, HOB'S,  and  HOP'S)  can  be 
thought  of  as  answering  the  questions  where,  when,  what, 
who,  why,  and  how."  [sef.  20:pg.  25] 

and  the  analysis  process  followed  that  of  Figure  20. 

This  enabled  the  CATRADA  analysts  to  compile  an  initial 

breakdown  of  subtasks  for  the  eight  EEA  which  were 

subseguently  organized  by  the  NTC  system  contractor.  Science 

Applications  Incorporated  (SAI) ,  of  El  Paso,  Texas,  into  the 

first  compendium  of  HOEs/NOPs,  entitled  National  Training 

Center;  EEA's.  HOE's.  HOP' s  [Ref.  33].  This  represented  the 

"first  cut"  of  ideas  regarding  what  the  NTC  subtask  analysis 
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should  contain,  and  were  based  initially  on  the  experience 
and  judgment  of  the  ailitary  officers  doing  the  analysis. 

Kith  the  additional  analytical  efforts  of  SAX,  the 
development  of  BOE/HOP  proceeded  apace.  The  next  draft  of 
HOE/MOP  contained  the  first  analysis  of  the  original  CATHADA 
work  restructured  in  teras  of  aanual  or  instruaented 
information  retrieval  systeas.  Entitled  Coabat  Evaluation 
Prograa  (EEA’s,  BOE*s .  MOP*sl  [Bef.  34],  this  document 
related  the  subtasks  of  Eeference  33  to  the  level  of  unit 
(platoon,  company,  or  battalion),  type  of  information 
retrieval  system  (aanual  or  instruaented)  and  stage  of 
development  of  the  ETC  at  which  the  HOE  would  be  introduced 
to  the  system.  This  subtasking  process  was  identical  to  the 
method  employed  by  AEI  in  the  structure  of  the  BE  ALTBAIN 
validation  studies  [Befs.  8,9,10,11]  and  represented 
accepted  state-of-the-art  analysis  of  the  coabat  process  for 
the  heavy  task  force. 

As  SAX  began  closer  integration  with  the  efforts  of  UTD- 
CATRADA  it  became  obvious  that  the  subtasking  analysis  was  a 
mammoth  task. 

nXn  order  to  address  the  large  nuaber  of  BOE's 
characterizing  Combined  Aras  force  on  fprce  exercises... 
Systematic  analysis  is  required  to  avoid  "getting  lost  in 
the  woods"  of  the  coabat  details.  Further,  it  is 
necessary  for  the  A AB  preparers  to  have  a  systematic 
interpretation  procedure  so, as  to  provide . sufficient 
comparative  data  so  as  to  diagnose  and  guide  aaxiaal 
corrective  action.  [Ref.  35: pg.  2-2] 


178 


The  level  of  detail,  if  carried  to  its  extremes  at  the 


lowest  echelons  of  a  unit,  threatened  to  overwhelm  any 


evaluation  or  feedback  system,  for  coabat  is  simply  a  very 


complex,  highly  synergistic  process.  Gradually  the  concept 


of  a  "hierarchy  of  detail"  or  "fineness  of  grain"  was 


inpleaented  in  the  analysis.  The  analysis  was: 


"...organized  in  a  systematic  fashion  utilizing  the 
concepts  of  EEA's,  HOE's,  and  HOP'S.  These  quantitative 
analyses  and  interpretations  provide  the  whyrs  of  the 
experience:  "what  happened  ana  wh$n  it  happened."  They 
provide  for  fine  grain  understanding  of  where  "things  went 
wrong"  and  the  desired  type  of  corrective  action."  [fief. 
35:pg.  2-2] 


This  concept  supported  the  top-down  analysis  and  enabled  SAI 


and  CATRADA  to  focus  the  evaluation.  Given  that  the  HTC 


would  be  structured  with  limited  funds  and  resources,  the 


entire  spectrum  of  battalion  coabat  operations  could  not  be 
evaluated  to  the  fine  grain  desired.  Therefore,  the 
continuing  analysis  for  the  NTC  was  structured  as  follows 


(see  Pigure  21)  : 


"Starting  with  the  core  actions  at  the  FEBA,  the  most 
important  SEA  relate  to  maneuver.  This  is  further 
supoorted  by  each  of  the  concurrent  seven  EEA  areas.  As 
indicated,  the  analysis  will  proceed  from  the  core  actions 
out  to  the  supporting  ESA's  such  as  Intelligence  and 
Counter-Intelligence."  [fief.  35:pg.  2-3] 


The  rationale  for  this  procedure  was: 


"Detail  will  focus  on  the  FEBA  as  represented  by  BLUEFOfi 
and  OPFOR  actions  and  reactions.  This  represents  the 
primary  NfC  objective  of  combat,  command,  and  personnel 
training  m  a  relative  environment. 


Timing—  flaneuver  measures  occur  in  seconds  and  meters 
while  Intelligence/Counter  Intelligence  measures  occur  in 
hours  and  kilometers,  thus  the  fine  grain  detail  of  coabat 


179 


Figure  21:  The  BTC  Combat  Bvaluational  Structure 


critical  events  of  maneuver  must  be  considered  prior  to 
the  longer  tern  events  froa  an  analysis  and  interpretation 
viewpoint. 


The  aaount  of  conaand  impacts  in  required  SOB*  s  are 

?reatest  in  maneuver  and  decrease  through  the  subsequent 
evels  of  2B&  analysis."  [Eef.  35:pg.  2-3] 


This  technique  allowed  the  process  of  KOB/HOP  development 


and  system  integration  to  proceed  and  culminated  in  the 


published  Interpretive  Guide  to  the  HTC  combat  evaluation 
program  £3ef.  35]  which  delineated  all  BOEs  and  their 


subordinate  BOPs  to  be  considered  at  the  BTC. 
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This  procedure  has  resulted  in  what  has  to  be  the  aost 
complete  indexing  to  date  of  the  tasks  and  subtasks  involved 
in  battalion  task  force  coabat.  Under  the  development  plan 
of  the  BTC ,  however,  these  BOB/BOP  are  not  to  be  regarded  as 
fixed  but  rather  as  initial  analysis  efforts.  Throughout 
the  future  operation  of  the  HTC  these  SOE/HOP  will  be 
subject  to  revision  as  the  training  battalions  provide  acre 
and  aore  inforaatioc  regarding  the  task  force  coabat  process 
[Bef.  14:pg.  III-9  to  III-11]. 

Therefore,  the  coabat  evaluation  program  may  rightly  be 
regarded  as  incomplete.  It  represents,  however,  the  best 
efforts  of  military  judgment  to  dissect  the  task  force 
coabat  process.  This  program  compares  favorably  to  aost 
other  analyses  of  this  nature  [Hefs.  36,37].  The  analysis 
is  prodigious  in  its  content,  and  although  all  aspects  of  it 
cannot  be  quantified  under  the  physical  limitations  of  the 
STC,  it  provides  a  "base  case"  analysis  and  identifies  the 
aost  critical  items  to  be  quantified.  These  MOE/tfOP  are 
truly  an  accurate  state-of-the-art  reflection  of  the  combat 
process  of  the  heavy  task  force. 


181 


AI2MJUI  l 


III  QQ  &  NT  I  PI  CAT  IQ  M  Q £  IA£li£kL  EE&ZQ& 1AILSS 

The  initial  MOE/SOP  development  has  followed  a  lengthy, 
complicated  process  and  it  is  recognized  that  these  measures 
should  be  reviewed  on  a  recurring  basis.  Any  need  for 
improvements,  refinements,  and  changes  will  hopefully  become 
apparent  through  repetitive  analysis  of  the  selected  HOPS. 
The  importance  of  these  SOPs  cannot  be  overstated  since  they 
provide  the  underlying  reason  why  specific  performance 
criteria  are  being  quantitatively  measured  by  the 
instrumentation  system.  The  entire  instrumented  environment 
at  the  NTC  has  been  designed  for  the  purpose  of  recording 
those  specific  events  and  occurrences  in  the  engagement 
simulation  exercise  that  are  necessary  to  evaluate  the 
training  standards  for  large  units — the  key  problem. 

Data  collected  by  the  Core  Instrumentation  Subsystem 
(CIS)  comes  from  two  sources:  the  instrumented  environment 
which  automatically  sends  objective  measures  at  designated 
tine  intervals,  and  field  observer/controllers  (POC's,  or 
later  OC's)  who  input  subjective  comments  and  information 
periodically  as  the  situation  dictates. 
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1.  AUTOMATIC  DATA  FROM  THE  INSTRUMENTED  ENVIRONMENT 

This  environment  consists  of  a  complex  interface  that 
combines  voice  and  video  recording  with  other  telemetry  to 
provide  certain  measured  data  to  the  CIS.  This  data  is 
manipulated  and  filed  so  that  it  represents  an  accurate 
portrayal  of  the  combat  activities  that  transpired  during  an 
exercise.  The  actual  quantifiable  items  being  measured  are 
outlined  below. 

1 .  Position  Location 

Every  instrumented  player  will  have  his  location 
measured  in  UTH  coordinates,  using  metric  system  units,  each 
30  seconds.  If  he  has  moved  less  than  16  meters  since  the 
previous  update  the  move  is  considered  insignificant  and  is 
not  recorded.  The  measured  data  will  be  filed  by  time 
sequence  and  individual  player  item  identification  [Ref. 

18:  pg.  3-1 4],  As  an  aid  to  map  coordinates  there  are  six 
video  teams  that  will  be  assigned  to  various  sectors  of  the 
battlefield.  Film  of  actual  locations  and  surrounding 
terrain  will  provide  enhanced  insight  into  actual  field 
positions  and  will  reflect  the  use  of  available  terrain 
features  for  cover  and  concealment.  Knowing  the  exact 
locations  of  players  allows  movement  distances  and  ranges 
between  various  players  to  be  accurately  computed. 
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2.  Bea£ons  Ei£ifla/£££es£g  £lS&£ 

When  a  weapon  is  fired  by  an  instruaented  player  a 
series  of  inforaation  is  automatically  recorded:  tiae  of 
firing,  identification  of  firer,  and  his  location.  When  a 
simulated  round  iapacts  on  or  near  an  instruaented  player 
siailar  inforaation  is  recorded:  tiae  of  impact, 
identification  of  the  target  player,  and  his  location.  As 
these  events  are  recorded  by  the  CIS  a  tiae  coincidence 
algorithm  is  activated  which  attempts  to  establish  a  pairing 
between  a  firer  and  a  target.  If  a  weapons  pairing  is 
satisfactorily  confirmed  the  recorded  inforaation  is  updated 
to  reflect  the  pairing  action  and  the  result  of  the 
engagement  i.e.  near  aiss,  hit,  or  kill.  Since  player 
identifications  are  assigned  prior  to  exercise  commencement 
the  type  of  weapon  system  firing  and  the  type  of  target  hit 
are  known  from  these  events.  (For  a  more  detailed 
discussion  of  the  pairing  process  refer  to  section  3. 2.2.2, 
Ref.  18:pg.  3-15.)  Proa  these  recorded  events  numerous  data 
items  can  be  compiled.  The  number  of  rounds  of  ammunition 
fired  by  individual  weapon  systea  type,  the  number  of  enemy 
targets  of  various  types  hit  and/or  killed,  engageaent 
distances  between  firers  and  targets,  the  current  status  of 
each  force  (i.e.  nuaber  of  players  alive  by  weapon  type), 
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and  many  other  such  objective  data  values  are  easily 

calculated.  Existing  instrumentation  at  the  NTC  is 

programmed  for  these  and  other  calculations. 

3.  Coamni cation  gaiiflfl  SlSfi* 

When  an  instruaented  radio  set  transmits  a  aessage 

the  beginning  and  ending  tiae  of  the  transmission  is 

autoaatically  recorded.  This  allows  for  the  computing  of 

the  number  and  duration  of  transmissions  by  radio  set  [Ref. 

18: pg.  3-18].  Additionally,  selected  radio  nets  will  be 

recorded  and/or  monitored  to  allow  for  analysis  of  radio 

message  content  if  desired.  This  will  be  helpful  in 

disclosing  communication  security  (COHSEC)  violations  or 

evaluating  operators  for  proper  radio  procedure. 

B.  DATA  FROM  OBSERVER/CONTROLLERS  (OC'S) 

Observer/Controllers  (OC's)  will  be  detailed  to  each 

unit  down  to  the  platoon  level  for  the  purpose  of  observing 

all  aspects  of  a  heavy  battalion's  combat  operations.  They 

will  use  ARTEP  71-2  for  performance  comparison  when 

conducting  evaluations  or  providing  information  to  the  CIS 

or  subsequent  feedback  to  the  evaluated  unit. 

"The  purpose  of  the  ...OC. ..is  to  provide  timely,  on-the- 
scene  information  (made  as  accurate  as  possible  through 
controls)  which  cannot  be  obtained  automatically."  [Ref. 
38: pg.  4-2]. 
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Certain  actions  within  the  various  levels  of  activity  are 
not  suitable  for  direct  instrumented  collection.  For 
example,  no  instruaentation  can  indicate  whether  or  not  the 
coaaander  used  available  battlefield  intelligence  in 
developing  his  plan  of  operations.  The  OC's  will  serve  as 
the  collection  source  for  this  type  of  unguantif iable  data 
[Hef.  38:pg.  1-12]. 

Prior  to  coaaenceaent  of  an  exercise  phase  each  OC  will 
be  given  a  selected  list  of  eleaents  of  inforaation  (El) 
which  he  aust  provide  to  the  CIS.  These  El  coae  froa  a 
developed  listing  of  approximately  200  iteas  that  cover  such 
areas  as  target  acquisition,  aanuever,  fire  support,  coaaand 
and  control,  logistics,  administration,  and  others.  The  OC 
will  conduct  his  subjective  evaluation  based  on  current 
doctrinal  publications  and  transmit  his  report  to  the  CIS. 
The  evaluations  can  be  in  the  form  of  a  nominal  measure 
ranging  froa  0  to  9  or  alternately  a  free  format  message 
describing  the  situation  [Hef.  18: pp.  3-25,3-26]. 

K  good  exaaple  of  the  OC  and  CIS  interface  is  provided 
by  the  use  of  indirect  fire,  ihen  the  CIS  is  notified  that 
indirect  fire  is  being  aiaed  at  a  unit  the  computer  provides 
time,  location  of  iapact,  number  and  type  of  rounds  to  be 
fired  and  the  expected  casualties  produced  based  on  the 


recorded  information  about  position  locations.  This 
inforaation  is  relayed  to  the  OC  who  marks  the  fires  on  the 
ground  and  then  uses  his  own  judgement  and  expertise  to 
determine,  if  in  fact  the  expected  casualties  did  occur. 

The  OC  then  provides  the  CIS  with  actual  combat  casualties 
and  takes  appropriate  action  to  designate  the  killed  players 
by  deactivating  their  MILES  equipment  with  his  controller 
key  device.  It  is  obvious  that  the  OC  input  has  a  direct 
influence  on  data  collected  in  this  type  of  engagement.  All 
OC  input  is  tagged  so  if  a  particular  individual  is 
considered  to  have  rendered  improper  assessments  a 
correction  is  possible. 

In  developing  an  objective  training  evaluation  the  use 
of  subjective  inputs  from  OC's  is  highly  questionable.  The 
affect  of  indirect  fire  casualty  assessments  and  some  other 
activities,  however,  ^ ust  necessarily  be  incorporated  into 
the  battle  outcome  data  as  no  other  system  exists  to 
simulate  these  combat  effects.  Thus,  in  the  scheme  of 
evaluating  training  standards,  the  OC's  will  play  an 
important,  albeit  less  statistically  reliable,  role. 
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THE  GENERATION  21  STATISTICAL  EVALUATIONS 

Presented  in  the  previous  section  is  the  actual  data 
being  collected  by  the  instrumentation  at  the  NTC.  The  iist 
of  iteas  measured  appears  to  span  only  a  Halted  array  of 
the  activities  planned  for  the  NTC  exercises.  However,  a 
thorough,  imaginative  eye  will  note  that  the  data  being 
collected  provides  the  information  necessary  to  conduct  an 
extensive  objective  training  evaluation.  These  collected 
data  iteas  can  be  manipulated  and  aggregated  to  generate 
useful  information  in  many  different  forms.  This  appendix 
will  be  devoted  to  explaining  how  these  data  iteas  can  be 
utilized  to  provide  an  objective  evaluation  of  unit  tactical 
performance  for  the  training  exercises  at  the  NTC. 

A.  GENERAL  PROCEDURE 

At  the  beginning  of  an  exercise  each  instrumented  player 
is  matched  with  a  designated  identification  code.  Any  data 
than  is  collected  concerning  a  player  will  be  stored  in  his 
unique  player  history  file  (PHF) ;  this  includes  weapon 
firings,  movement,  change  in  status  from  alive  to  killed, 
etc.  When  an  event  occurs  the  data  describing  that  event  is 
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recorded  and  stored  in  the  appropriate  PHFs.  To  facilitate 
the  aggregation  of  data  by  units  (platoons,  coapanies,  etc.) 
each  player  is  assigned  to  a  specific  tactical  unit,  k 
listing  of  identification  codes  for  all  members  belonging  to 
a  unit  is  aaintained  in  the  CIS  for  reference  and  for 
sorting  data.  During  an  exercise,  players  aay  be  cross- 
attached  to  adjacent  eleaents.  When  this  occurs  all 
subsequent  activities  concerning  that  player  will  be 
credited  to  the  new  unit. 

Since  participating  units  in  the  NTC  exercises  are 
coaprised  of  aany  diverse  weapon  systea  types,  i.e. 
dismounted  infantry,  tanks,  various  types  of  anti-tank 
weapons,  aortars,  artillery,  etc.,  it  is  desirable  to  have  a 
method  of  comparing  the  "combat  power'*  capability  of  two 
opposing  units.  Military  planners  and  operations  analysts, 
for  at  least  thirty  years,  have  used  various  "firepower- 
score"  approaches  for  aggregating  the  diverse  combat 
capabilities  of  a  heterogeneous  military  force  into  a  single 
number  that  measures  coabat  power.  Bach  weapon  type  is 
assigned  a  score  or  weighted  effectiveness  index  (WEI)  that 
represents  its  coabat  potential  and  the  combat  power  of  a 
unit  is  obtained  by  sunning  the  scores  of  all  live  players 
belonging  to  that  unit  and  forming  the  weighted  unit  value 
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(VUV)  [Hef.  39:  pp.  85-86].  TfiiOOC  has  provided  a  listing  of 
numbers  referred  to  as  the  WEI/MOV  table  to  the  ETC  (see 
Figure  22) ,  and  this  is  stored  in  the  CIS  master  file  to 
supply  the  firepower  scores  necessary  for  coaputing  the 
coabat  power  of  units. 

The  ETC  instruaentation  is  currently  programmed  to 
compute  and  update  selected  statistics  every  five  minutes 
for  a  aaxiaua  of  50  units.  Each  platoon,  company,  and 
battalion  is  considered  a  separate  unit.  For  example,  a 
battalion  consisting  of  only  3  companies  with  4  platoons  in 
each  company  would  be  a  total  of  16  units;  i.e.  12  platoons, 
3  companies,  and  1  battalion.  The  statistics  are  aggregated 
upward  through  every  echelon.  The  instrumentation  is 
flexible  and  can  accomodate  reorganization  of  entire  units. 
All  statist:  *.  computed  following  a  change  in  unit 
organization  will  incorporate  those  players  who  currently 
belong  to  the  designated  unit.  The  data,  and  subsequent 
computed  statistics,  are  compiled  for  each  exercise  segment. 
Exercise  egments  are  event  driven  and  can  last  from  4  to  48 
hours  with  an  average  duration  of  about  8  to  12  hours.  The 
segments  are  delineated  by:  natural  engagement  breaks;  a 
change  in  tactical  mission;  moving  to  a  new  terrain  area;  a 
change  in  environmental  conditions;  or  a  command  decision. 
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These  are  the  weighted  values  used  at  the  NTC, 
as  derived  from  TSADOC  sources. 
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Figure  22:  weights  for  Coaputing  Unit  scores 

Since  each  segaent  presents  a  different  situation  to  the 
training  unit  it  seeas  appropriate  to  consider  each  segaent 
as  a  separate  evaluation  of  the  unit  perforaance  [Ref. 

18: pp.  3-11  to  3-27]. 
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All  recorded  data  iteas  are  objective  numbers  that  can 
be  used  in  various  aatheaatical  operations  to  generate  a 
truly  objective  measure  of  unit  performance.  The  BOEs/BOPs 
developed  by  CATBAD1  provide  the  basis  for  constructing  a 
unit  evaluation.  If  the  BOEs/BOPs  mere  to  change  in  the 
future,  then  the  recorded  data  would  be  altered  to  a 
different  format  to  provide  a  new  objective  measure.  The 
NTC  instrumentation  is  programmed  for  expansion  in  phases 
over  the  next  few  years.  As  the  instrumented  system  grows 
the  number  and  variety  of  statistics  available  for 
computation  can  be  increased  accordingly. 

B.  THE  STATISTICAL  REPRESENTATION  OP  BOBS 

The  ultimate  purpose  of  the  NTC  instrumentation  is  to 
record  data  for  use  in  providing  a  training  evaluation  to 
the  heavy  task  force.  To  achieve  this  end,  the  HOE/MOP 
structure  developed  jointly  by  CATBADA  and  SAI  had  to  be 
translated  into  calculable  statistical  entities.  This 
difficult  process  was  conducted  over  a  long  period  of  time 
on  an  ad  hoc  basis21  between  the  two  agencies,  and  resulted 
in  the  player  tactical  performance  kernel  statistics 


21  Per  conversations  with  Hich  Scagglioni,  SAI  La- Jolla, 
CA,  and  Norma  Perez,  §AI-E1  Paso,  TX,  m  November  and 
December  of  1981.  This  interfacing  process  between  the 
contractor,  SAI,  and  the  developing  agency,  here  CATRADA, 
was  not  documented  in  writing. 
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[Ref.  40:pg.  >22  to  3-26].  The  major  areas  addressed  by 
the  statistics  include:  overall  engageaent  effectiveness, 
movement,  weapon  effectiveness,  and  coaa unications.  These 
statistics  provide  quantitative  aeasures  of  unit  performance 
in  each  of  the  specified  areas,  and  currently  serve  as  the 
objective  base  that  supports  the  training  evaluation 
provided  to  each  unit. 

The  statistics  generated  in  this  category  provide  a 
general  overview  of  the  unit's  ability  to  accomplish  its 
assigned  mission.  The  following  numbers  will  be  computed 
each  update  period  for  both  the  friendly  and  the  OPFOH 
units. 

dumber  of  casualties —  &  count  of  the  number  of 
instrumented  players  killed. 

Overall  force  value — The  sum  of  the  combat  power  for 
live  players  belonging  to  that  unit.  The  combat  power 
is  obtained  from  the  WEI/WBV  table  stored  in  the  CIS. 

2l§EtH  force  value  Iqss  aegsure — Total  combat  power 
lost  by  the  unit  during  that  update  period. 

Porce  in  contact  aeasur e--When  a  pairing  event  between 
a  firer  and  a  target  is  recorded,  the  platoons  to 
which  these  players  are  attached  is  considered  to  be 
in  contact.  The  measure  will  be  the  total  number  of 
platoons  in  contact  (each  platoon  will  only  be  counted 
once  during  an  update  period) . 
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f2£SS  engage »ent  Measure — When  a  pairing  event  occurs, 
the  firer  weapon  will  be  considered  engaged.  The 
total  force  engaged  on  each  side  will  be  the  sue  of 
conbat  power  engaged  (each  player  counted  only  once 
for  an  update  period).  [Ref.  4G:pp.  3-22  to  3-23] 

2.  flgveaaal 

The  following  statistics  represent  the  unit's 

ability  to  maneuver  on  the  battlefield.  These  statistics 

can  be  used  to  provide  an  indication  of  how  well  the  unit 

used  available  terrain,  whether  or  not  an  adequate  route 

reconnaisance  was  performed,  etc.  Alone,  these  numbers  are 

not  very  useful  in  conducting  a  training  evaluation,  but 

when  coupled  with  other  information,  such  as  overall 

engagement  effectiveness,  they  provide  an  insight  to 

possible  deficiencies.  Each  number  will  be  computed  for 

both  the  OPFOR  and  friendly  units  for  each  update  period. 

Rate  of  advance — The  center  of  mass  of  each  unit  will 
be  computed  based  on  the  locations  of  players 
belonging  to  the  unit.  The  distance  between  beginning 
and  ending  center  of  mass  points  divided  by  the  length 
of  time  between  updates  will  produce  this  average  rate 
of  advance  value. 

fiate  s£.  advance  towa^fl  4  destination — The  distance  of 
unit  movement  projected  on  the  line  from  the  unit's 
center  of  mass  to  a  manually  designated  objective 
divided  by  the  length  of  time.  [Ref.  40: pg.  3-23] 
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3.  Isafion  gffectiveaess 

The  ability  of  soldiers  to  properly  and  efficiently 
use  their  weapon  firepower  in  coebat  is  a  viral  necessity 
for  survival.  However,  being  effective  with  weapons  does 
not  ensure  success  on  the  battlefield;  success  is  achieved 
through  the  proper  integration  and  utilization  of  several 
coebat  skills.  The  statistics  in  this  area  do  provide  an 
effectiveness  aeasure  for  weapon  eaploysent.  They  can  be 
used  to  evaluate  earksaanship  capability,  to  determine  if 
soldiers  are  estimating  distances  correctly  before  directing 
fire  at  a  target,  etc.  numbers  of  this  type  provide 
aeasures  that  can  be  used  to  evaluate  key  areas  of  overall 
unit  performance.  Every  number  will  be  computed  each  update 
period. 

Bounds  fired — The  number  of  rounds  fired  by  each 
instrumented  weapon  type  for  both  friendly  and  OPFOH 
units,  k  cumulative  number  of  rounds  fired  by  each 
friendly  unit  for  tank  main  gun  and  coax,  TOM,  Dragon, 
and  Viper,  k  similar  cumulative  count  for  OPFOB 
Sagger,  tank  main  gun  and  coax.  One  firing  message  of 
the  coax  will  be  considered  100  rounds. 

Firing  results — The  number  of  near  misses,  hits,  and 
kills  by  friendly  units  with  tank  main  gun  and  coax, 

TO»,  Dragon,  and  Viper  against  OPFOB  targets  of  tank, 

BHP  and  BHDH-2.  The  associated  cumulative  values  for 
the  engagement  segment  will  be  maintained. 
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fif  firing  resalts — The  ratio  of  total  firings  to 
near  misses,  hits,  and  kills  by  friendly  unit  for  tank 
aain  gun  and  coax,  TOW,  Dragon,  and  Viper  and  a 
similar  ratio  for  Sagger,  tank  aain  gun  and  coax  0PF06 
weapons. 

&£§£££  flast. Jtoaal  Jsiil  slf££iiisas§s*-fhe  total  value 
(from  the  WBI/WOV  table)  of  opposing  players  killed  by 
tank  aain  gun  and  antitank  weapons  (TOW,  Dragon,  and 
Viper  for  friendly  and  Sagger  for  OPFOB)  divided  by 
the  total  value  of  opposing  players  killed. 

Weapon  engagement  range — The  range  froa  a  weapon  to 
the  target  in  a  pairing  event,  by  weapon  effect  (near 
aiss,  hit,  kill)  for  tank  aain  gun  and  antitank 
weapons  (TOW  for  friendly  and  Sagger  for  CPFOB ) .  A 
cumulative  frequency  count  will  be  collected  in  15 
range  intervals  of  200  aeters  each. 

Stas  kill  range — The  average  distance  between  friendly 
and  OPFOS  tank  aain  guns  and  antitank  weapons  (TOW  and 
Sagger)  when  a  vehicle  kill  was  obtained.  [Bef. 

40: pp.  3-23  to  3-24] 

4 .  Coaaupicatiops 

A  unit's  ability  to  effectively  employ  radio 
communications  has  an  important  iapact  on  battle  outcome. 
The  following  statistics  can  be  used  to  support  and 
identify  suspected  training  deficiencies  reported  in  the 
unit  evaluation. 

Mumbey  q>f  communications — The  number  of  radio 
transmissions  initiated  during  the  update  period. 
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Ayerage  trafisajssion  duration— Average  length  of  all 
radio  transaissions  for  that  period  as  well  as  the 
average  duration  of  transaissions  during  the  entire 
engageaent  segaent.  These  average  durations  will  he 
coaputed  for  each  unit  as  veil  as  aggregated  to  an 
overall  BL0EFOB  and  OPFOfi  average  duration. 

Significant  transaissions— Total  nun  her  of 
transaissions  exceeding  25  seconds ,  but  less  than  55 
seconds.  Total  nuaber  of  transaissions  lasting  55 
seconds  or  longer.  [Hef.  40: pp.  3-24  to  3-25] 

These  statistics  represent  the  final  culaination  of  the 

Coabat  Evaluation  Prograa  initiated  at  CATBADA  to  support 

the  ETC.  The  exhaustive  top-down  analysis  of  the  heavy  task 

force  coabat  process  yielded  a  series  of  SEA ,  HOE,  and  HOP 

which  were  translated  into  coaputer  hardware  and  software  by 

SAI,  and  the  resulting  structure  of  evaluation  as  it  exists 

today  at  the  ETC  has  been  presented  here. 
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Aggmat  s 


CURRENT  LlflUATIQNS  Q£  QUAHTI FICATIOH 

Every  operation,  no  aatter  how  detailed  or  complex,  is 
designed  to  perfora  specific  functions.  Kith  aeticulons 
effort  devoted  to  operational  design  nuaerous  functions  are 
possible,  but  there  will  always  be  soae  cut-off  point  or 
limit  where  the  effort  aust  end.  The  NIC  instruaented 
environment  is  an  example  of  such  a  complex  operation. 
Following  the  extensive  HOE  development,  considerable  effort 
was  directed  toward  the  evaluation  process  itself.  Since 
the  planners  were  restricted  to  using  "off-the-shelf" 
instrumentation  and  were  held  to  a  relatively  short 
preparation  tine,  initial  work  has  been  devoted  to 
guantifying  those  data  sources  deemed  most  crucial  to 
assisting  a  heavy  battalion  task  force  in  identifying 
training  deficiencies. 

The  paramount  objective  of  the  NTC  is  to  provide  a 
realistic  environment  to  facilitate  combat  learning  and 
evaluate  a  unit's  ability  to  survive  and  accomplish  its 
mission.  The  HTC  instrumentation  has  been  oriented  toward 
collecting  data  in  support  of  the  combat  activities  that 
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occur  within  the  span  of  the  participating  soldiers,  and  it 
does  this  exteresely  well.  Seal  tise  casualty  assessment 
with  NILES  and  other  core  instruaent  systaas  provide  a 
fairly  thorough  coverage  of  the  critical  tactical  events  of 
the  engageaent  siaulation  exercises.  The  quantitative 
■ensures,  as  outlined  earlier,  provide  the  information 
necessary  to  reconstruct  "what,  when,  and  where"  for  the 
analysis  of  tactical  events.  This  represents  a  aajor 
accomplishment  over  the  current  systea  of  subjective 
training  evaluations.  However,  there  are  aspects  of  the 
coabat  process  that  are  neglected.  These  areas  are  the 
combat  activities  that  do  not  impact  directly  on  the 
learning  of  the  participating  soldiers,  A  discussion  of 
these  areas  is  provided  only  to  illustrate  the  limitations 
of  the  NTC. 

The  EEAs  for  the  HTC  have  been  displayed  pictorially  as 
shown  in  Pigure  21.  One  can  see  froa  this  Pigure  that  the 
EEA  fora  concurrent  rings  that  eaanate  outward  froa  the 
forward  line  of  troops  (foraerly  refered  to  as  the  FEBA) . 
This  is  to  indicate  that  the  crucial  EEA  which  impact  aost 
on  a  battalion  task  force  evaluation  begin  at  the  site  of 
the  battle.  When  a  friendly  unit  maneuvers  against  a 
thinking  OPPOB  capable  of  counter  aoves  a  learning  process 
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results.  Activities  occurring  further  away  fro*  the  battle 
site  are  iaportant  in  the  sequence  of  coabat  learning,  but 
the  impact  is  not  iaaediately  felt  by  the  participating 
soldiers.  These  aore  distant  SEA  require  additional  tine 
and  exaaination  to  determine  their  impact  on  the  battle 
outcome  and  thereby  produce  any  degree  of  benefit  to  coabat 
learning.  Thus,  they  are  less  crucial  to  analysis  as 
performed  at  the  ETC. 

Since  the  quantification  of  coabat  activities  at  the  NTC 

had  to  be  somewhat  restricted,  only  the  most  crucial  areas 

could  be  covered  by  instruaentation  in  the  initial  phases  of 

NTC  development.  As  very  aptly  put, 

"Maneuver  measures  occur  in  seconds  and  meters  while 
Intelligence  /  Counter  Intelligence  measures  occur  in 
hours  and  Kilometers,  thus  the  fine  grain  detail  of  combat 
critical  events  must  be  considered  prior  to  the  longer 
term  events  from  an  analysis  and  interpretation 
viewpoint."  [Ref.  35:pg.  2-3] 

Using  this  rationale,  the  initial  instruaentation  at  the  NTC 
has  been  directed  toward  collecting  data  in  support  of  the 
"close-in"  EEAs  which  include:  maneuver,  fire  support, 
mobility/counter  aobility/survivability,  and  air  defense. 

The  major  limitations  of  the  NTC  instrumentation  therefore 
fall  under  the  headings  of  the  four  outer  most  EEAs  of 
Figure  21,  which  are:  coabat  service  support,  nuclear. 


biological,  and  cheaical  (NBC)  ,  command,  control,  and 
commun ications  (C*) ,  and  intelligence/counter  intelligence. 

The  limitation  of  the  instruments  to  provide  specific 
guantifiable  aeasures  to  support  the  evaluation  of  these 
outer  BEAs  is  well  recognized.  Field  observer/controllers 
(OC)  are  directed  toward  gathering  information  and  data 
needed  to  evaluate  these  areas.  The  training  analysis  and 
feedback  (TAF)  personnel  monitor  all  collected  data  and  then 
search  for  the  cause  of  identified  training  deficiencies,  in 
an  attempt  to  relate  this  essentially  unguantifiable  data  to 
the  mission  outcome. 

Thus,  in  any  further  discussion  of  the  evaluation  of 
training  standards,  an  important  point  to  consider  will  be 
what  impact  these  limitations  have  on  the  task  force 
evaluation.  The  purpose  of  the  NTC,  once  again,  is  to 
provide  a  realistic  combat  environment.  The  instrumentation 
package  can  now  accurately  display  the  tactical  combat 
events  which  occur  during  engagement  simulation  exercises. 
The  TAP  and  OC  personnel  will  assist  the  unit  commander  and 
his  staff  in  identifying  what  they  suspect  as  training 
deficiencies,  but  it  is  ultimately  the  responsibility  of 
each  commander  and  his  staff  to  determine  the  cause  of  those 
weaknesses.  aith  the  after  action  reviews  and  diagnostic 
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take-hoae  package  provided  to  the  unit  by  the  NTC,  it  should 
be  able  to  conduct  reaedial  training  at  its  hoae  station  and 
identify  the  appropriate  deficiency  that  caused  a  particular 
problem,  without  the  use  of  NTC  instruaentation. 

These  systea  liaitations  have  been  recognized  and 
efforts  are  being  aade  to  reduce  then.  The  NTC  is  being 
expanded  in  phases  over  the  next  few  years.  As  sore  tine 
and  aoney  are  aade  available  the  instruaentation 
capabilities  will  become  aore  sophisticated,  and  a  i  w_der 
spectrua  of  data  will  be  collected,  Much  effort  has  >en 
devoted  to  analyzing  the  coaplexity  of  the  combat  p:  ». 

When  these  details  can  be  accurately  developed  to  represent 
the  soldier* s  actions  then  more  specific  NOEs/HOPs  can  be 
selected  for  measuring  by  instruaents.  Finally,  the  EEAs  in 
the  outer  rings  of  Figure  15  are  not  completely 
quantifiable;  the  data  necessary  to  aeasure  the  performance 
in  these  areas  is  not  well  defined.  Until  the  "fuzzy  area" 
of  what  exactly  is  intelligence/counter  intelligence  or  C3, 
(and  how  they  should  be  evaluated)  is  established,  these 
areas  cannot  be  accurately  quantified. 

The  major  point  to  be  aade  is  that  the  NTC  instrumented 
environaent  possesses  certain  limitations.  The 
instruaentation  is  collecting  data  to  support  EE&  deemed 
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lost  crucial  for  evaluation  of  tactical  coibat  events  near 
the  site  of  the  battle,  and  this  it  does  well.  The  SEA  that 
represent  longer  ten  activities  are  not  currently 
adequately  quantifiable.  There  are  sources  at  the  NTC  and 
at  hoae  stations  to  assisx  in  evaluating  unit  perforaance  on 
these  EEA;  the  realistic  battlefield  at  NTC  is  not  crucial 
in  producing  an  evaluation  of  thei.  Limitations  of  the  NTC 
instrumented  environs ent  are  recognized  and  during  the 
expansion  phases  of  NTC  soae  of  these  limitations  will  be 
eliminated. 
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